Method for driving display device

ABSTRACT

A low-resolution image is displayed at higher resolution and afterimages are reduced. Resolution is made higher by super-resolution processing. In this case, the super-resolution processing is performed after frame interpolation processing is performed. Further, in that case, the super-resolution processing is performed using a plurality of processing systems. Therefore, even when frame frequency is made higher, the super-resolution processing can be performed at high speed. Further, since frame rate doubling is performed by the frame interpolation processing, afterimages can be reduced.

TECHNICAL FIELD

The present invention relates to display devices, liquid crystal displaydevices, semiconductor devices, production methods thereof, or methodsfor using the display devices, the liquid crystal display devices, orthe semiconductor devices. In particular, the present invention relatesto driving methods of display devices, liquid crystal display devices,semiconductor devices, or the like, or signal processing methodsthereof.

BACKGROUND ART

In recent years, flat panel displays typified by liquid crystal displayshave been widely used. In addition, flat panels have been furtherimproved in many respects. One of specifications of flat panels isresolution (or the number of pixels). Resolution has also beendrastically improved.

Therefore, a super-resolution processing technology, which is atechnology for converting low-resolution images into high-resolutionimages, has been studied (see References 1 to 3).

REFERENCE

Reference 1: Japanese Published Patent Application No. 2008-160565

Reference 2: Japanese Published Patent Application No. 2008-085411

Reference 3: Japanese Published Patent Application No. 2008-252701

DISCLOSURE OF INVENTION

In liquid crystal displays, a variety of methods for improving imagequality have been studied. Therefore, in flat panel displays typified byliquid crystal displays, in the case where processing for improvingimage quality is performed, a variety of problems may be caused. Forexample, any of the following problems may be caused; the decrease inimage quality, impossibility of display of correct images, the increasein power consumption, the increase in noise, necessity of extracomponents, the increase in cost, the increase in the size of devices,the increase in the frames of display devices, the decrease inprocessing speed, the decrease in display speed, and the decrease inframe frequency.

From the above, it is an object of one embodiment of the presentinvention to provide a device having higher image quality, a drivingmethod thereof, or a manufacturing method thereof. Alternatively, it isan object of one embodiment of the present invention to provide a devicewhich displays a correct image, a driving method thereof, or amanufacturing method thereof. Alternatively, it is an object of oneembodiment of the present invention to provide a device with low powerconsumption, a driving method thereof, or a manufacturing methodthereof. Alternatively, it is an object of one embodiment of the presentinvention to provide a device with little noise, a driving methodthereof, or a manufacturing method thereof. Alternatively, it is anobject of one embodiment of the present invention to provide a devicehaving fewer components, a driving method thereof, or a manufacturingmethod thereof. Alternatively, it is an object of one embodiment of thepresent invention to provide a device manufactured at low cost, adriving method thereof, or a manufacturing method thereof.Alternatively, it is an object of one embodiment of the presentinvention to provide a smaller device, a driving method thereof, or amanufacturing method thereof. Alternatively, it is an object of oneembodiment of the present invention to provide a device with a narrowframe, a driving method thereof, or a manufacturing method thereof.Alternatively, it is an object of one embodiment of the presentinvention to provide a high-speed processing device, a driving methodthereof, or a manufacturing method thereof. Alternatively, it is anobject of one embodiment of the present invention to provide a devicewhich performs display at high speed, a driving method thereof, or amanufacturing method thereof. Alternatively, it is an object of oneembodiment of the present invention to provide a device whose framefrequency is not low, a driving method thereof, or a manufacturingmethod thereof. Alternatively, it is an object of one embodiment of thepresent invention to provide a device with fewer afterimages, a drivingmethod thereof, or a manufacturing method thereof. Alternatively, it isan object of one embodiment of the present invention to provide ahigh-contrast device, a driving method thereof, or a manufacturingmethod thereof. Note that the description of these objects does notimpede the existence of other objects. Note that in one embodiment ofthe present invention, there is no need to achieve all the objects.

After interpolation of frame data for displaying an image at higherframe frequency is performed, a low-resolution image is converted into ahigh-resolution image with a super-resolution processing technology.Then, image processing such as edge enhancement, data processing forlocal dimming (local luminance control) using a backlight, dataprocessing for overdrive, or the like is performed.

Alternatively, interpolation of frame data for displaying an image athigher frame frequency is performed and a low-resolution image isconverted into a high-resolution image with a super-resolutionprocessing technology. Then, image processing such as edge enhancement,or interpolation of frame data for displaying an image at higher framefrequency are performed. After that, data processing for local dimmingusing a backlight, data processing for overdrive, or the like isperformed.

Therefore, a method for driving a liquid crystal display device, whichincludes a first step of performing frame interpolation processing and asecond step of performing super-resolution processing, is provided. Thesecond step is performed after the first step.

Alternatively, a method for driving a liquid crystal display device,which includes a first step of performing frame interpolation processingand a second step of performing super-resolution processing, isprovided. A period during which the first step and the second step areconcurrently performed is provided.

Alternatively, a method for driving a liquid crystal display device,which includes a first step of performing frame interpolationprocessing, a second step of performing first super-resolutionprocessing, and a third step of performing second super-resolutionprocessing, is provided. The second step or the third step is performedafter the first step.

Alternatively, a method for driving a liquid crystal display device,which includes a first step of performing frame interpolationprocessing, a second step of performing super-resolution processing, anda third step of performing local dimming processing, is provided. Thesecond step is performed after the first step. The third step isperformed after the second step.

Alternatively, a method for driving a liquid crystal display device,which includes a first step of performing frame interpolationprocessing, a second step of performing super-resolution processing, athird step of performing local dimming processing, and a fourth step ofperforming overdrive processing, is provided. The second step isperformed after the first step. The third step is performed after thesecond step. The fourth step is performed after the third step.

Note that a variety of switches can be used as a switch. For example, anelectrical switch, a mechanical switch, or the like can be used. Thatis, any element can be used as long as it can control a current flow,without limitation to a certain element. For example, a transistor(e.g., a bipolar transistor or a MOS transistor), a diode (e.g., a PNdiode, a PIN diode, a Schottky diode, an MIM (metal insulator metal)diode, an MIS (metal insulator semiconductor) diode, or adiode-connected transistor), or the like can be used as a switch.Alternatively, a logic circuit in which such elements are combined canbe used as a switch.

An example of a mechanical switch is a switch formed using a MEMS (microelectro mechanical system) technology, such as a digital micromirrordevice (DMD). Such a switch includes an electrode which can be movedmechanically, and operates by controlling conduction and non-conductionin accordance with movement of the electrode.

In the case of using a transistor as a switch, the polarity(conductivity type) of the transistor is not particularly limited to acertain type because it operates just as a switch. However, a transistorhaving polarity with smaller off-state current is preferably used whenthe amount of off-state current is to be suppressed. Examples of atransistor with smaller off-state current are a transistor provided withan LDD region, a transistor with a multi-gate structure, and the like.Further, an n-channel transistor is preferably used when a potential ofa source terminal of the transistor which is operated as a switch isclose to a potential of a low-potential-side power supply (e.g., Vss,GND, or 0 V). On the other hand, a p-channel transistor is preferablyused when the potential of the source terminal is close to a potentialof a high-potential-side power supply (e.g., Vdd). This is because theabsolute value of gate-source voltage can be increased when thepotential of the source terminal of the n-channel transistor is close toa potential of a low-potential-side power supply and when the potentialof the source terminal of the p-channel transistor is close to apotential of a high-potential-side power supply, so that the transistorcan be more accurately operated as a switch. This is also because thetransistor does not often perform source follower operation, so thatreduction in output voltage does not often occur.

Note that a CMOS switch may be used as a switch by using both ann-channel transistor and a p-channel transistor. By using a CMOS switch,the switch can be more accurately operated as a switch because currentcan flow when either the p-channel transistor or the n-channeltransistor is turned on. For example, voltage can be appropriatelyoutput regardless of whether voltage of an input signal to the switch ishigh or low. In addition, since the voltage amplitude value of a signalfor turning on or off the switch can be made smaller, power consumptioncan be reduced.

Note that when a transistor is used as a switch, the switch includes aninput terminal (one of a source terminal and a drain terminal), anoutput terminal (the other of the source terminal and the drainterminal), and a terminal for controlling conduction (a gate terminal).On the other hand, when a diode is used as a switch, the switch does notinclude a terminal for controlling conduction in some cases. Therefore,when a diode is used as a switch, the number of wirings for controllingterminals can be further reduced as compared to the case of using atransistor.

Note that when it is explicitly described that “A and B are connected”,the case where A and B are electrically connected, the case where A andB are functionally connected, and the case where A and B are directlyconnected are included therein. Here, each of A and B is an object(e.g., a device, an element, a circuit, a wiring, an electrode, aterminal, a conductive film, or a layer). Accordingly, another elementmay be interposed between elements having a connection relationillustrated in drawings and texts, without limitation to a predeterminedconnection relation, for example, the connection relation illustrated inthe drawings and the texts.

For example, in the case where A and B are electrically connected, oneor more elements which enable electrical connection between A and B(e.g., a switch, a transistor, a capacitor, an inductor, a resistor,and/or a diode) may be connected between A and B. Alternatively, in thecase where A and B are functionally connected, one or more circuitswhich enable functional connection between A and B (e.g., a logiccircuit such as an inverter, a NAND circuit, or a NOR circuit; a signalconverter circuit such as a DA converter circuit, an AD convertercircuit, or a gamma correction circuit; a potential level convertercircuit such as a power supply circuit (e.g., a dc-dc converter, astep-up dc-dc converter, or a step-down dc-dc converter) or a levelshifter circuit for changing a potential level of a signal; a voltagesource; a current source; a switching circuit; an amplifier circuit suchas a circuit which can increase signal amplitude, the amount of current,or the like, an operational amplifier, a differential amplifier circuit,a source follower circuit, or a buffer circuit; a signal generationcircuit; a memory circuit; and/or a control circuit) may be connectedbetween A and B. For example, in the case where a signal output from Ais transmitted to B even when another circuit is interposed between Aand B, A and B are functionally connected.

Note that when it is explicitly described that “A and B are electricallyconnected”, the case where A and B are electrically connected (i.e., thecase where A and B are connected with another element or another circuitinterposed therebetween), the case where A and B are functionallyconnected (i.e., the case where A and B are functionally connected withanother circuit interposed therebetween), and the case where A and B aredirectly connected (i.e., the case where A and B are connected withoutanother element or another circuit interposed therebetween) are includedtherein. That is, when it is explicitly described that “A and B areelectrically connected”, the description is the same as the case whereit is explicitly only described that “A and B are connected”.

Note that a display element, a display device which is a deviceincluding a display element, a light-emitting element, and alight-emitting device which is a device including a light-emittingelement can employ various modes and can include various elements. Forexample, a display medium, whose contrast, luminance, reflectivity,transmittance, or the like changes by electromagnetic action, such as anEL (electroluminescence) element (e.g., an EL element including organicand inorganic materials, an organic EL element, or an inorganic ELelement), an LED (e.g., a white LED, a red LED, a green LED, or a blueLED), a transistor (a transistor which emits light depending on theamount of current), an electron emitter, a liquid crystal element,electronic ink, an electrophoretic element, a grating light valve (GLV),a plasma display panel (PDP), a digital micromirror device (DMD), apiezoelectric ceramic display, or a carbon nanotube can be used as adisplay element, a display device, a light-emitting element, or alight-emitting device. Note that display devices having EL elementsinclude an EL display; display devices having electron emitters includea field emission display (FED), an SED-type flat panel display (SED:surface-conduction electron-emitter display), and the like; displaydevices having liquid crystal elements include a liquid crystal display(e.g., a transmissive liquid crystal display, a transflective liquidcrystal display, a reflective liquid crystal display, a direct-viewliquid crystal display, or a projection liquid crystal display); displaydevices having electronic ink or electrophoretic elements includeelectronic paper.

Note that an EL element is an element including an anode, a cathode, andan EL layer interposed between the anode and the cathode. Note that asan EL layer, a layer utilizing light emission (fluorescence) from asinglet exciton, a layer utilizing light emission (phosphorescence) froma triplet exciton, a layer utilizing light emission (fluorescence) froma singlet exciton and light emission (phosphorescence) from a tripletexciton, a layer formed using an organic material, a layer formed usingan inorganic material, a layer formed using an organic material and aninorganic material, a layer including a high-molecular material, a layerincluding a low-molecular material, a layer including a high-molecularmaterial and a low-molecular material, or the like can be used. Notethat the present invention is not limited to this, and a variety of ELelements can be used as an EL element.

Note that an electron emitter is an element in which electrons areextracted by high electric field concentration on a cathode. Forexample, as an electron emitter, a Spindt type, a carbon nanotube (CNT)type, a metal-insulator-metal (MIM) type in which a metal, an insulator,and a metal are stacked, a metal-insulator-semiconductor (MIS) type inwhich a metal, an insulator, and a semiconductor are stacked, a MOStype, a silicon type, a thin film diode type, a diamond type, a thinfilm type in which a metal, an insulator, a semiconductor, and a metalare stacked, a HEED type, an EL type, a porous silicon type, asurface-conduction (SCE) type, or the like can be used. Note that thepresent invention is not limited to this, and a variety of elements canbe used as an electron emitter.

Note that a liquid crystal element is an element which controlstransmission or non-transmission of light by optical modulation actionof liquid crystals and includes a pair of electrodes and liquidcrystals. Note that the optical modulation action of liquid crystals iscontrolled by an electric field applied to the liquid crystals(including a horizontal electric field, a vertical electric field, and adiagonal electric field). Note that the following can be used for aliquid crystal element: a nematic liquid crystal, a cholesteric liquidcrystal, a smectic liquid crystal, a discotic liquid crystal, athermotropic liquid crystal, a lyotropic liquid crystal, a low-molecularliquid crystal, a high-molecular liquid crystal, a polymer dispersedliquid crystal (PDLC), a ferroelectric liquid crystal, ananti-ferroelectric liquid crystal, a main-chain liquid crystal, aside-chain high-molecular liquid crystal, a plasma addressed liquidcrystal (PALC), a banana-shaped liquid crystal, and the like. Inaddition, the following can be used as a diving method of a liquidcrystal: a TN (twisted nematic) mode, an STN (super twisted nematic)mode, an IPS (in-plane-switching) mode, an FFS (fringe field switching)mode, an MVA (multi-domain vertical alignment) mode, a PVA (patternedvertical alignment) mode, an ASV (advanced super view) mode, an ASM(axially symmetric aligned microcell) mode, an OCB (opticallycompensated birefringence) mode, an ECB (electrically controlledbirefringence) mode, an FLC (ferroelectric liquid crystal) mode, an AFLC(anti-ferroelectric liquid crystal) mode, a PDLC (polymer dispersedliquid crystal) mode, a guest-host mode, a blue phase mode, and thelike. Note that the present invention is not limited to this, and avariety of liquid crystal elements and driving methods thereof can beused as a liquid crystal element and a driving method thereof.

Note that electronic paper corresponds to a device for displaying imagesby molecules (a device which utilizes optical anisotropy, dye molecularorientation, or the like), a device for displaying images by particles(a device which utilizes electrophoresis, particle movement, particlerotation, phase change, or the like), a device for displaying images bymovement of one end of a film, a device for displaying images by usingcoloring properties or phase change of molecules, a device fordisplaying images by using optical absorption by molecules, or a devicefor displaying images by using self-light emission by combination ofelectrons and holes. For example, the following can be used for adisplay method of electronic paper: microcapsule electrophoresis,horizontal electrophoresis, vertical electrophoresis, a sphericaltwisting ball, a magnetic twisting ball, a columnar twisting ball, acharged toner, an electron powder and granular material, magneticelectrophoresis, a magnetic thermosensitive type, electro wetting,light-scattering (transparent-opaque change), a cholesteric liquidcrystal and a photoconductive layer, a cholesteric liquid crystaldevice, a bistable nematic liquid crystal, a ferroelectric liquidcrystal, a liquid crystal dispersed type with a dichroic dye, a movablefilm, coloring and decoloring properties of a leuco dye, photochromism,electrochromism, electrodeposition, flexible organic EL, and the like.Note that the present invention is not limited to this, and a variety ofelectronic paper and display methods thereof can be used as electronicpaper and a driving method thereof. Here, by using microcapsuleelectrophoresis, defects of electrophoresis, which are aggregation andprecipitation of phoresis particles, can be solved. Electron powder andgranular material has advantages such as high-speed response, highreflectivity, wide viewing angle, low power consumption, and memoryproperties.

Note that a plasma display panel has a structure where a substratehaving a surface provided with an electrode faces with a substratehaving a surface provided with an electrode and a minute groove in whicha phosphor layer is formed at a narrow interval and a rare gas is sealedtherein. Alternatively, the plasma display panel can have a structurewhere a plasma tube is sandwiched between film-form electrodes from thetop and the bottom. The plasma tube is formed by sealing a dischargegas, RGB fluorescent materials, and the like inside a glass tube. Notethat the plasma display panel can perform display by application ofvoltage between the electrodes to generate an ultraviolet ray so that aphosphor emits light. Note that the plasma display panel may be aDC-type PDP or an AC-type PDP. Here, as a driving method of the plasmadisplay panel, AWS (address while sustain) driving, ADS (address displayseparated) driving in which a subframe is divided into a reset period,an address period, and a sustain period, CLEAR (high-contrast and lowenergy address and reduction of false contour sequence) driving, ALIS(alternate lighting of surfaces) method, TERES (technology of reciprocalsustainer) driving, or the like can be used. Note that the presentinvention is not limited to this, and a variety of driving methods canbe used as a driving method of a plasma display panel.

Note that electroluminescence, a cold cathode fluorescent lamp, a hotcathode fluorescent lamp, an LED, a laser light source, a mercury lamp,or the like can be used as a light source of a display device in which alight source is needed, such as a liquid crystal display (e.g., atransmissive liquid crystal display, a transflective liquid crystaldisplay, a reflective liquid crystal display, a direct-view liquidcrystal display, or a projection liquid crystal display), a displaydevice including a grating light valve (GLV), or a display deviceincluding a digital micromirror device (DMD). Note that the presentinvention is not limited to this, and a variety of light sources can beused as a light source.

Note that a variety of transistors can be used as a transistor, withoutlimitation to a certain type. For example, a thin film transistor (TFT)including a non-single-crystal semiconductor film typified by amorphoussilicon, polycrystalline silicon, microcrystalline (also referred to asmicrocrystal, nanocrystal, or semi-amorphous) silicon, or the like canbe used. In the case of using the TFT, there are various advantages. Forexample, since the TFT can be formed at temperature which is lower thanthat of the case of using single crystal silicon, manufacturing cost canbe reduced or a manufacturing apparatus can be made larger. Since themanufacturing apparatus can be made larger, the TFT can be formed usinga large substrate. Therefore, many display devices can be formed at thesame time at low cost. In addition, since the manufacturing temperatureis low, a substrate having low heat resistance can be used. Therefore,the transistor can be formed using a light-transmitting substrate.Further, transmission of light in a display element can be controlled byusing the transistor formed using the light-transmitting substrate.Alternatively, part of a film included in the transistor can transmitlight because the thickness of the transistor is small. Therefore, theaperture ratio can be improved.

Note that by using a catalyst (e.g., nickel) in the case of formingpolycrystalline silicon, crystallinity can be further improved and atransistor having excellent electrical characteristics can be formed.Accordingly, a gate driver circuit (e.g., a scan line driver circuit), asource driver circuit (e.g., a signal line driver circuit), and/or asignal processing circuit (e.g., a signal generation circuit, a gammacorrection circuit, or a DA converter circuit) can be formed using thesame substrate as a pixel portion.

Note that by using a catalyst (e.g., nickel) in the case of formingmicrocrystalline silicon, crystallinity can be further improved and atransistor having excellent electrical characteristics can be formed. Inthis case, crystallinity can be improved by just performing heattreatment without performing laser irradiation. Accordingly, a gatedriver circuit (e.g., a scan line driver circuit) and part of a sourcedriver circuit (e.g., an analog switch) can be formed using the samesubstrate as a pixel portion. In addition, in the case of not performinglaser irradiation for crystallization, unevenness in crystallinity ofsilicon can be suppressed. Therefore, high-quality images can bedisplayed.

Note that polycrystalline silicon and microcrystalline silicon can beformed without using a catalyst (e.g., nickel).

Note that it is preferable that crystallinity of silicon be improved topolycrystal, microcrystal, or the like in the whole panel; however, thepresent invention is not limited to this. Crystallinity of silicon maybe improved only in part of the panel. Selective improvement incrystallinity is possible by selective laser irradiation or the like.For example, only a peripheral driver circuit region excluding pixelsmay be irradiated with laser light. Alternatively, only a region of agate driver circuit, a source driver circuit, or the like may beirradiated with laser light. Alternatively, only part of a source drivercircuit (e.g., an analog switch) may be irradiated with laser light.Accordingly, crystallinity of silicon can be improved only in a regionin which a circuit needs to be operated at high speed. Since a pixelregion is not particularly needed to be operated at high speed, even ifcrystallinity is not improved, the pixel circuit can be operated withoutproblems. Since a region whose crystallinity is improved is small,manufacturing steps can be decreased, throughput can be increased, andmanufacturing cost can be reduced. Since the number of necessarymanufacturing apparatus is small, manufacturing cost can be reduced.

A transistor can be formed using a semiconductor substrate, an SOIsubstrate, or the like. Thus, a transistor with fewer variations incharacteristics, sizes, shapes, or the like, with high current supplycapability, and with a small size can be formed. By using such atransistor, power consumption of a circuit can be reduced or a circuitcan be highly integrated.

A transistor including a compound semiconductor or an oxidesemiconductor, such as ZnO, a-InGaZnO, SiGe, GaAs, IZO (indium zincoxide), ITO (indium tin oxide), SnO, TiO, or AlZnSnO (AZTO), a thin filmtransistor obtained by thinning such a compound semiconductor or anoxide semiconductor, or the like can be used. Thus, manufacturingtemperature can be lowered and for example, such a transistor can beformed at room temperature. Accordingly, the transistor can be formeddirectly on a substrate having low heat resistance, such as a plasticsubstrate or a film substrate. Note that such a compound semiconductoror an oxide semiconductor can be used not only for a channel portion ofthe transistor but also for other applications. For example, such acompound semiconductor or an oxide semiconductor can be used for aresistor, a pixel electrode, or a light-transmitting electrode. Further,since such an element can be formed at the same time as the transistor,cost can be reduced.

A transistor or the like formed by an inkjet method or a printing methodcan be used. Thus, a transistor can be formed at room temperature, canbe formed at a low vacuum, or can be formed using a large substrate.Since the transistor can be formed without using a mask (reticle), thelayout of the transistor can be easily changed. Further, since it is notnecessary to use a resist, material cost is reduced and the number ofsteps can be reduced. Furthermore, since a film is formed only in anecessary portion, a material is not wasted as compared to amanufacturing method by which etching is performed after the film isformed over the entire surface, so that cost can be reduced.

A transistor or the like including an organic semiconductor or a carbonnanotube can be used. Thus, such a transistor can be formed over aflexible substrate. A semiconductor device formed using such a substratecan resist shocks.

Further, transistors with a variety of structures can be used. Forexample, a MOS transistor, a junction transistor, a bipolar transistor,or the like can be used as a transistor. By using a MOS transistor, thesize of the transistor can be reduced. Thus, a large number oftransistors can be mounted. By using a bipolar transistor, large currentcan flow. Thus, a circuit can be operated at high speed.

Note that a MOS transistor, a bipolar transistor, and the like may beformed over one substrate. Thus, reduction in power consumption,reduction in size, high-speed operation, and the like can be achieved.

Furthermore, a variety of transistors can be used.

Note that a transistor can be formed using a variety of substrates,without limitation to a certain type. As the substrate, a single crystalsubstrate (e.g., a silicon substrate), an SOI substrate, a glasssubstrate, a quartz substrate, a plastic substrate, a metal substrate, astainless steel substrate, a substrate including stainless steel foil, atungsten substrate, a substrate including tungsten foil, a flexiblesubstrate, or the like can be used, for example. As a glass substrate, abarium borosilicate glass substrate, an aluminoborosilicate glasssubstrate, or the like can be used, for example. For a flexiblesubstrate, a flexible synthetic resin such as plastics typified bypolyethylene terephthalate (PET), polyethylene naphthalate (PEN), andpolyether sulfone (RES), or acrylic can be used, for example.Alternatively, an attachment film (formed using polypropylene,polyester, vinyl, polyvinyl fluoride, polyvinyl chloride, or the like),paper of a fibrous material, a base material film (formed usingpolyester, polyamide, polyimide, an inorganic vapor deposition film,paper, or the like), or the like can be used. Alternatively, thetransistor may be formed using one substrate, and then, the transistormay be transferred to another substrate. A single crystal substrate, anSOT substrate, a glass substrate, a quartz substrate, a plasticsubstrate, a paper substrate, a cellophane substrate, a stone substrate,a wood substrate, a cloth substrate (including a natural fiber (e.g.,silk, cotton, or hemp), a synthetic fiber (e.g., nylon, polyurethane, orpolyester), a regenerated fiber (e.g., acetate, cupra, rayon, orregenerated polyester), or the like), a leather substrate, a rubbersubstrate, a stainless steel substrate, a substrate including astainless steel foil, or the like can be used as a substrate to whichthe transistor is transferred. Alternatively, a skin (e.g., epidermis orcorium) or hypodermal tissue of an animal such as a human being can beused as a substrate to which the transistor is transferred.Alternatively, the transistor may be formed using one substrate and thesubstrate may be thinned by polishing. A single crystal substrate, anSOI substrate, a glass substrate, a quartz substrate, a plasticsubstrate, a stainless steel substrate, a substrate including astainless steel foil, or the like can be used as a substrate to bepolished. By using such a substrate, a transistor with excellentproperties or a transistor with low power consumption can be formed, adevice with high durability and high heat resistance can be provided, orreduction in weight or thickness can be achieved.

Note that the structure of a transistor can be a variety of structures,without limitation to a certain structure. For example, a multi-gatestructure having two or more gate electrodes can be used. By using themulti-gate structure, a structure where a plurality of transistors areconnected in series is provided because channel regions are connected inseries. With the multi-gate structure, the amount of off state currentcan be reduced and the withstand voltage of the transistor can beincreased (reliability can be improved). Further, with the multi-gatestructure, drain-source current does not fluctuate very much even whendrain-source voltage fluctuates when the transistor operates in asaturation region, so that a flat slope of voltage-currentcharacteristics can be obtained. By utilizing the flat slope of thevoltage-current characteristics, an ideal current source circuit or anactive load having an extremely large resistance value can be realized.Accordingly, a differential circuit or a current mirror circuit havingexcellent properties can be realized.

As another example, a structure where gate electrodes are formed aboveand below a channel can be used. By using the structure where gateelectrodes are formed above and below the channel, a channel region isincreased, so that the amount of current can be increased.Alternatively, by using the structure where gate electrodes are formedabove and below the channel, a depletion layer can be easily formed, sothat subthreshold swing can be improved. Note that when the gateelectrodes are formed above and below the channel, a structure where aplurality of transistors are connected in parallel is provided.

A structure where a gate electrode is formed above a channel region, astructure where a gate electrode is formed below a channel region, astaggered structure, an inverted staggered structure, a structure wherea channel region is divided into a plurality of regions, or a structurewhere channel regions are connected in parallel or in series can beused. Alternatively, a structure where a source electrode or a drainelectrode overlaps with a channel region (or part of it) can be used. Byusing the structure where the source electrode or the drain electrodeoverlaps with the channel region (or part of it), unstable operation dueto accumulation of electric charge in part of the channel region can beprevented. Alternatively, a structure where an LDD region is providedcan be used. By providing the LDD region, the amount of off-statecurrent can be reduced or the withstand voltage of the transistor can beincreased (reliability can be improved). Further, by providing the LDDregion, drain-source current does not fluctuate very much even whendrain-source voltage fluctuates when the transistor operates in thesaturation region, so that the inclination of a voltage-current diagramcan be flattened.

Note that a variety of transistors can be used as a transistor, and thetransistor can be formed using a variety of substrates. Accordingly, allthe circuits that are necessary to realize a predetermined function canbe formed using the same substrate. For example, all the circuits thatare necessary to realize the predetermined function can be formed usinga glass substrate, a plastic substrate, a single crystal substrate, anSOI substrate, or any other substrate. When all the circuits that arenecessary to realize the predetermined function are formed using thesame substrate, cost can be reduced by reduction in the number ofcomponents or reliability can be improved by reduction in the number ofconnections to circuit components. Alternatively, some of the circuitswhich are necessary to realize the predetermined function can be formedusing one substrate and some of the circuits which are necessary torealize the predetermined function can be formed using anothersubstrate. That is, not all the circuits that are necessary to realizethe predetermined function are required to be formed using the samesubstrate. For example, some of the circuits which are necessary torealize the predetermined function can be formed by transistors using aglass substrate and some of the circuits which are necessary to realizethe predetermined function can be formed using a single crystalsubstrate, so that an IC chip formed by a transistor using the singlecrystal substrate can be connected to the glass substrate by COG (chipon glass) and the IC chip may be provided over the glass substrate.Alternatively, the IC chip can be connected to the glass substrate byTAB (tape automated bonding) or a printed wiring board. When some of thecircuits are formed using the same substrate in this manner, cost can bereduced by reduction in the number of components or reliability can beimproved by reduction in the number of connections to circuitcomponents. Alternatively, when circuits with high driving voltage andhigh driving frequency, which consume large power, are formed using asingle crystal substrate instead of forming such circuits using the samesubstrate, and an IC chip formed by the circuits is used, for example,the increase in power consumption can be prevented.

Note that one pixel corresponds to the minimum unit of an image.Accordingly, in the case of a full color display device having colorelements of R (red), G (green), and B (blue), one pixel includes a dotof the color element of R, a dot of the color element of G, and a dot ofthe color element of B. Note that the color elements are not limited tothree colors, and color elements of more than three colors may be usedor a color other than RGB may be used. For example, RGBW (W correspondsto white) can be used by adding white. Alternatively, one or more colorsof yellow, cyan, magenta, emerald green, vermilion, and the like may beadded to RGB, for example. Alternatively, a color which is similar to atleast one of R, G, and B may be added to RGB, for example. For example,R, G, B1, and B2 may be used. Although both B1 and B2 are blue, theyhave slightly different wavelengths. In a similar manner, R1, R2, G andB may be used. By using such color elements, display which is closer tothe real object can be performed or power consumption can be reduced.Note that one pixel may include a plurality of dots of color elements ofthe same color. In this case, the plurality of color elements may havedifferent sizes of regions which contribute to display. Alternatively,by separately controlling the plurality of dots of color elements of thesame color, gradation may be expressed. This method is referred to as anarea-ratio gray scale method. Alternatively, by using the plurality ofdots of color elements of the same color, signals supplied to each ofthe plurality of dots may be slightly varied so that the viewing angleis widened. That is, potentials of pixel electrodes included in theplurality of color elements of the same color may be different from eachother. Accordingly, voltage applied to liquid crystal molecules arevaried depending on the pixel electrodes. Therefore, the viewing anglecan be widened.

Note that in the case of illustrating a circuit diagram, for example,one pixel corresponds to one element whose brightness can be controlledin some cases. Therefore, in that case, one pixel corresponds to onecolor element and brightness is expressed with the one color element.Accordingly, in that case, in the case of a color display device havingcolor elements of R (red), G (green), and B (blue), the minimum unit ofan image includes three pixels of an R pixel, a G pixel, and a B pixelin some cases.

Note that pixels are provided (arranged) in matrix in some cases. Here,description that pixels are provided (arranged) in matrix includes thecase where the pixels are arranged in a straight line and the case wherethe pixels are arranged in a jagged line, in a longitudinal direction ora lateral direction. Thus, for example, in the case of performing fullcolor display with three color elements (e.g., RGB), the following casesare included: the case where the pixels are arranged in stripes and thecase where dots of the three color elements are arranged in a deltapattern. In addition, the case is also included in which dots of thethree color elements are provided in Bayer arrangement. Note that thesize of display regions may be different between dots of color elements.Thus, power consumption can be reduced or the life of a display elementcan be prolonged.

Note that an active matrix method in which an active element is includedin a pixel or a passive matrix method in which an active element is notincluded in a pixel can be used.

In an active matrix method, as an active element (a non-linear element),not only a transistor but also a variety of active elements (non-linearelements) can be used. For example, an MIM (metal insulator metal), aTFD (thin film diode), or the like can also be used. Since such anelement has a small number of manufacturing steps, manufacturing costcan be reduced or yield can be improved. Further, since the size of theelement is small, the aperture ratio can be improved, so that powerconsumption can be reduced or higher luminance can be achieved.

Note that as a method other than the active matrix method, a passivematrix method in which an active element (a non-linear element) is notused can be used. Since an active element (a non-linear element) is notused, the number of manufacturing steps is small, so that manufacturingcost can be reduced or yield can be improved. Further, since an activeelement (a non-linear element) is not used, the aperture ratio can beimproved, so that power consumption can be reduced or higher luminancecan be achieved.

Note that a transistor is an element having at least three terminals ofa gate, a drain, and a source. The transistor has a channel regionbetween a drain region and a source region, and current can flow throughthe drain region, the channel region, and the source region. Here, sincethe source and the drain of the transistor change depending on thestructure, the operating condition, and the like of the transistor, itis difficult to define which is a source or a drain. Thus, a regionwhich serves as a source and a drain is not referred to as a source or adrain in some cases. In that case, one of the source and the drain mightbe referred to as a first terminal and the other of the source and thedrain might be referred to as a second terminal, for example.Alternatively, one of the source and the drain might be referred to as afirst electrode and the other of the source and the drain might bereferred to as a second electrode. Alternatively, one of the source andthe drain might be referred to as a first region and the other of thesource and the drain might be referred to as a second region.

Note that a transistor may be an element having at least three terminalsof a base, an emitter, and a collector. In this case, in a similarmanner, one of the emitter and the collector might be referred to as afirst terminal and the other of the emitter and the collector might bereferred to as a second terminal.

Note that a semiconductor device corresponds to a device having acircuit including a semiconductor element (e.g., a transistor, a diode,or a thyristor). The semiconductor device may also correspond to alldevices that can function by utilizing semiconductor characteristics. Inaddition, the semiconductor device corresponds to a device having asemiconductor material.

Note that a display device corresponds to a device having a displayelement. The display device may include a plurality of pixels eachhaving a display element. Note that that the display device may includea peripheral driver circuit for driving the plurality of pixels. Theperipheral driver circuit for driving the plurality of pixels may beformed using the same substrate as the plurality of pixels. The displaydevice may include a peripheral driver circuit provided over a substrateby wire bonding or bump bonding, namely, an IC chip connected by chip onglass (COG) or an IC chip connected by TAB or the like. The displaydevice may include a flexible printed circuit (FPC) to which an IC chip,a resistor, a capacitor, an inductor, a transistor, or the like isattached. Note that the display device may include a printed wiringboard (PWB) which is connected through a flexible printed circuit (FPC)and to which an IC chip, a resistor, a capacitor, an inductor, atransistor, or the like is attached. The display device may include anoptical sheet such as a polarizing plate or a retardation plate. Thedisplay device may include a lighting device, a housing, an audio inputand output device, an optical sensor, or the like.

Note that a lighting device may include a backlight unit, a light guideplate, a prism sheet, a diffusion sheet, a reflective sheet, a lightsource (e.g., an LED or a cold cathode fluorescent lamp), a coolingdevice (e.g., a water cooling device or an air cooling device), or thelike.

Note that a light-emitting device corresponds to a device having alight-emitting element or the like. In the case where a light-emittingdevice includes a light-emitting element as a display element, thelight-emitting device is one of specific examples of a display device.

Note that a reflective device corresponds to a device having alight-reflective element, a light diffraction element, light-reflectiveelectrode, or the like.

Note that a liquid crystal display device corresponds to a displaydevice including a liquid crystal element. Liquid crystal displaydevices include a direct-view liquid crystal display, a projectionliquid crystal display, a transmissive liquid crystal display, areflective liquid crystal display, a transflective liquid crystaldisplay, and the like.

Note that a driving device corresponds to a device having asemiconductor element, an electric circuit, or an electronic circuit.For example, a transistor which controls input of signals from a sourcesignal line to pixels (also referred to as a selection transistor, aswitching transistor, or the like), a transistor which supplies voltageor current to a pixel electrode, a transistor which supplies voltage orcurrent to a light-emitting element, and the like are examples of thedriving device. A circuit which supplies signals to a gate signal line(also referred to as a gate driver, a gate line driver circuit, or thelike), a circuit which supplies signals to a source signal line (alsoreferred to as a source driver, a source line driver circuit, or thelike), and the like are also examples of the driving device.

Note that a display device, a semiconductor device, a lighting device, acooling device, a light-emitting device, a reflective device, a drivingdevice, and the like overlap with each other in some cases. For example,a display device includes a semiconductor device and a light-emittingdevice in some cases. Alternatively, a semiconductor device includes adisplay device and a driving device in some cases.

Note that when it is explicitly described that “B is formed on A” or “Bis formed over A”, it does not necessarily mean that B is formed indirect contact with A. The description includes the case where A and Bare not in direct contact with each other, i.e., the case where anotherobject is interposed between A and B. Here, each of A and B is an object(e.g., a device, an element, a circuit, a wiring, an electrode, aterminal, a conductive film, or a layer).

Accordingly, for example, when it is explicitly described that “a layerB is formed on (or over) a layer A”, it includes both the case where thelayer B is formed in direct contact with the layer A, and the case whereanother layer (e.g., a layer C or a layer D) is formed in direct contactwith the layer A and the layer B is formed in direct contact with thelayer C or the layer D. Note that another layer (e.g., a layer C or alayer D) may be a single layer or a plurality of layers.

In a similar manner, when it is explicitly described that “B is formedabove A”, it does not necessarily mean that B is formed in directcontact with A, and another object may be interposed therebetween. Thus,for example, when it is described that “a layer B is formed above alayer A”, it includes both the case where the layer B is formed indirect contact with the layer A, and the case where another layer (e.g.,a layer C or a layer D) is formed in direct contact with the layer A andthe layer B is formed in direct contact with the layer C or the layer D.Note that another layer (e.g., a layer C or a layer D) may be a singlelayer or a plurality of layers.

Note that when it is explicitly described that “B is formed on A”, “B isformed over A”, or “B is formed above A”, it includes the case where Bis formed obliquely over/above A.

Note that the same can be said when it is described that “B is formedunder A” or “B is formed below A”.

Note that when an object is explicitly described in a singular form, theobject is preferably singular. Note that the present invention is notlimited to this, and the object can be plural. In a similar manner, whenan object is explicitly described in a plural form, the object ispreferably plural. Note that the present invention is not limited tothis, and the object can be singular.

Note that size, the thickness of layers, or regions in the drawings areexaggerated for simplicity in some cases. Thus, the embodiments of thepresent invention are not limited to such scales illustrated in thedrawings.

Note that the drawings are perspective views of ideal examples, andshapes or values are not limited to those illustrated in the drawings.For example, the following can be included: variation in shape due to amanufacturing technique; variation in shape due to an error; variationin signal, voltage, or current due to noise; variation in signal,voltage, or current due to a difference in timing: or the like.

Note that technical terms are used in order to describe a specificembodiment, example, or the like in many cases. However, one embodimentof the present invention should not be construed as being limited by thetechnical terms.

Note that terms which are not defined (including terms used for scienceand technology, such as technical terms or academic parlance) can beused as terms which have meaning equal to general meaning that anordinary person skilled in the art understands. It is preferable thatterms defined by dictionaries or the like be construed as consistentmeaning with the background of related art.

Note that terms such as “first”, “second”, “third”, and the like areused for distinguishing various elements, members, regions, layers, andareas from others. Therefore, the terms such as “first”, “second”,“third”, and the like do not limit the number of the elements, members,regions, layers, areas, or the like. Further, for example, “first” canbe replaced with “second”, “third”, or the like.

Note that terms for describing spatial arrangement, such as “over”,“above”, “under”, “below”, “laterally”, “right”, “left”, “obliquely”,“behind”, “front”, “inside”, “outside”, and “in” are often used forbriefly showing a relationship between an element and another element orbetween a feature and another feature with reference to a diagram. Notethat the embodiments of the present invention are not limited to this,and such terms for describing spatial arrangement can indicate not onlythe direction illustrated in a diagram but also another direction. Forexample, when it is explicitly described that “B is over A”, it does notnecessarily mean that B is placed over A, and can include the case whereB is placed under A because a device in a diagram can be inverted orrotated by 180°. Accordingly, “over” can refer to the directiondescribed by “under” in addition to the direction described by “over”.Note that the embodiments of the present invention are not limited tothis, and “over” can refer to any of the other directions described by“laterally”, “right”, “left”, “obliquely”, “behind”, “front”, “inside”,“outside”, and “in” in addition to the directions described by “over”and “under” because the device in the diagram can be rotated in avariety of directions. That is, the terms for describing spatialarrangement can be construed adequately depending on the situation.

According to one embodiment of the present invention, image quality canbe improved.

BRIEF DESCRIPTION OF DRAWINGS

In the accompanying drawings:

FIGS. 1A to 1C illustrate flows according to one example of anembodiment;

FIGS. 2A to 2C show display screens according to one example of theembodiment;

FIGS. 3A to 3D illustrate flows according to one example of theembodiment;

FIGS. 4A to 4C illustrate flows according to one example of theembodiment;

FIGS. 5A to 5C illustrate flows according to one example of theembodiment;

FIGS. 6A to 6C illustrate circuits according to one example of theembodiment;

FIGS. 7A to 7E illustrate flows according to one example of anembodiment;

FIGS. 8A to 8E illustrate flows according to one example of theembodiment;

FIGS. 9A and 9B illustrate flows according to one example of theembodiment;

FIGS. 10A and 10B illustrate flows according to one example of anembodiment;

FIGS. 11A and 11B illustrate flows according to one example of theembodiment;

FIGS. 12A and 12B illustrate flows according to one example of theembodiment;

FIG. 13A is a top view illustrating a device according to one example ofan embodiment, and FIG. 13B is a cross-sectional view illustrating thedevice;

FIGS. 14A and 14C are top views illustrating a device according to oneexample of the embodiment, and FIGS. 14B and 14D are cross-sectionalviews illustrating the device;

FIGS. 15A, 15C, and 15E show voltage of a display element according toone example of an embodiment, and FIGS. 15B, 15D, and 15F showtransmittance of the display element;

FIGS. 16A to 16C show display screens according to one example of anembodiment;

FIGS. 17A to 17G illustrate circuits according to one example of anembodiment;

FIGS. 18A to 18H illustrate circuits according to one example of theembodiment;

FIGS. 19A and 19B illustrate structures of display devices according toone example of an embodiment;

FIGS. 20A to 20E illustrate structures of display devices according toone example of the embodiment;

FIGS. 21A to 21C are cross-sectional views illustrating structures oftransistors according to one example of an embodiment;

FIGS. 22A to 22H illustrate electronic devices according to one exampleof an embodiment; and

FIGS. 23A to 23H illustrate electronic devices according to one exampleof the embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments will be described with reference to thedrawings. Note that the embodiments can be implemented in variousdifferent ways and it will be readily appreciated by those skilled inthe art that modes and details of the embodiments can be changed invarious ways without departing from the spirit and scope of the presentinvention. Therefore, the present invention should not be construed asbeing limited to the following description of the embodiments. Note thatin structures described below, the same portions or portions havingsimilar functions are denoted by common reference numerals in differentdrawings, and description thereof is not repeated.

Note that a content (or may be part of the content) described in oneembodiment may be applied to, combined with, or replaced by a differentcontent (or may be part of the different content) described in theembodiment and/or a content (or may be part of the content) described inone or a plurality of different embodiments.

Note that in each embodiment, a content described in the embodiment is acontent described with reference to a variety of diagrams or a contentdescribed with a text described in this specification.

Note that by combining a diagram (or may be part of the diagram)illustrated in one embodiment with another part of the diagram, adifferent diagram (or may be part of the different diagram) illustratedin the embodiment, and/or a diagram (or may be part of the diagram)illustrated in one or a plurality of different embodiments, much morediagrams can be formed.

Note that in a diagram or a text described in one embodiment, part ofthe diagram or the text is taken out, and one embodiment of theinvention can be constituted. Thus, in the case where a diagram or atext related to a certain portion is described, the context taken outfrom part of the diagram or the text is also disclosed as one embodimentof the invention, and one embodiment of the invention can beconstituted. Therefore, for example, in a diagram (e.g., across-sectional view, a plan view, a circuit diagram, a block diagram, aflow chart, a process diagram, a perspective view, a cubic diagram, alayout diagram, a timing chart, a structure diagram, a schematic view, agraph, a list, a ray diagram, a vector diagram, a phase diagram, awaveform chart, a photograph, or a chemical formula) or a text in whichone or more active elements (e.g., transistors or diodes), wirings,passive elements (e.g., capacitors or resistors), conductive layers,insulating layers, semiconductor layers, organic materials, inorganicmaterials, components, substrates, modules, devices, solids, liquids,gases, operating methods, manufacturing methods, or the like aredescribed, part of the diagram or the text is taken out, and oneembodiment of the invention can be constituted. For example, M pieces ofcircuit elements (e.g., transistors or capacitors) (M is an integer,where M<N) are taken out from a circuit diagram in which N pieces ofcircuit elements (e.g., transistors or capacitors) (N is an integer) areprovided, and one embodiment of the invention can be constituted. Asanother example, M pieces of layers (M is an integer, where M<N) aretaken out from a cross-sectional view in which N pieces of layers (N isan integer) are provided, and one embodiment of the invention can beconstituted. As another example, M pieces of elements (M is an integer,where M<N) are taken out from a flow chart in which N pieces of elements(N is an integer) are provided, and one embodiment of the invention canbe constituted.

Embodiment 1

Super-resolution processing is processing for generating high-resolutionimages from low-resolution images. Alternatively, super-resolutionprocessing is processing for restoring lost data in photographing,signal transmitting, or the like. Therefore, by performingsuper-resolution processing on averaged images whose detailed parts arecrushed due to low resolution, images whose detailed parts can beaccurately recognized can be generated. Thus, in the case of displayingsuch high-resolution images, high-quality images can be displayed. Forexample, in the case of an image of a park where a great number of smallstones are disposed or a tree having a great number of small leaves, byperforming super-resolution processing, an image of each small stone oreach small leaf can be accurately recognized. In a similar manner, byperforming super-resolution processing, detailed parts of a characterwhich cannot be read due to blur can be recognized. Thus, the charactercan be accurately read. That is, the character can be read as if aperson viewing the character recovered his/her eyesight. For example, insuper-resolution processing, an image having a resolution (the number ofpixels) of 1920×1080 is generated from an image having a resolution (thenumber of pixels) of 1440×1080 by restoration of image data. That is, itcan be said that a super-resolution processing technology is atechnology by which the amount of image data is increased from anoriginal image and resolution conversion is performed. Alternatively, itcan be said that a super-resolution processing is a technology by whicha frequency component which is higher than Nyquist frequency determinedby standard frequency of an input image is restored in data contained inan image.

In hold-type displays such as liquid crystal display devices, in thecase where fast-moving images are displayed, motion blur occurs andafterimages are seen in some cases. For example, in the case where acharacter is displayed in a ticker and is moved up and down or right andleft, the character is blurred and cannot be accurately recognized insome cases.

Therefore, by performing frame interpolation processing, frame frequencycan be improved and the resolution of moving images can be improved. Theframe interpolation processing is processing by which frame data isinterpolated when display is performed at higher frame frequency inorder to reduce afterimages or the like. For example, as illustrated inFIG. 2A, a circle is displayed on the left in an image of a first frame,and the circle is moved from left to right in an image of a second frameand is displayed on the right. In this case, data where a circle isdisplayed in the center is generated. Processing by which data isgenerated in this manner is the frame interpolation processing. Inaddition, by the frame interpolation processing, frame frequency indisplay can be made higher by the number of interpolated frames. Byperforming display with frame frequency made higher by frameinterpolation processing in this manner, a smooth image where a circleis moved from left to right can be displayed and afterimages can bereduced. Therefore, since moving images can be displayed without blur,the resolution of the moving images can be improved. Note that in thisspecification, the resolution of moving images refers to visualresolution in displaying moving images and resolution which is perceivedby a person in displaying moving images. For example, the resolution ofmoving images refers to the limiting resolution at which intervals canbe recognized in the case where a wedged figure is scrolled on a screen.

Driving by which frame interpolation is performed and frame frequency ismade higher to a corresponding extent in this manner is referred to asframe rate doubling. For example, when frame frequency is double, suchdriving is referred to as double-frame rate driving. When framefrequency is quadruple, such driving is referred to as quadruple-framerate driving. In the case of the double-frame rate driving, images offrames whose number is the same as the number of original frames aregenerated by frame interpolation processing. Accordingly, the totalamount of data is double, so that images can be displayed at doubleframe frequency. In a similar manner, in the case of the quadruple-framerate driving, images of frames whose number is three times as large asthe number of original frames are generated by frame interpolationprocessing. Accordingly, the total amount of data is quadruple, so thatimages can be displayed at quadruple frame frequency. By performing suchframe rate doubling, moving-image characteristics can be improved andafterimages can be reduced. As a display device to which frame ratedoubling is applied, a hold-type display device is preferable. Forexample, the frame rate doubling is preferably applied to a liquidcrystal display, an organic EL display, or the like. Since afterimagesare easily visible in hold-type display devices, afterimages can bereduced by frame rate doubling.

Thus, by performing both frame interpolation processing andsuper-resolution processing, the resolution of still images and theresolution of moving images can be improved. If neither frameinterpolation processing nor frame rate doubling is performed but onlysuper-resolution processing is performed, images are blurred due toafterimages or the like though the resolution of the images is madehigher by the super-resolution processing. Thus, the higher resolutioncannot be easily perceived. That is, an advantageous effect of thesuper-resolution processing is reduced. Alternatively, ifsuper-resolution processing is not performed but only frameinterpolation processing and frame rate doubling are performed, theresolution of images to be displayed itself is low though the movingimages can be accurately perceived. Therefore, high-quality imagescannot be displayed. Accordingly, regardless of still images or movingimages, it is preferable to perform both frame interpolation processingand super-resolution processing in order to display high-resolutionimages accurately. Note that one example of this embodiment is notlimited to this.

Thus, FIGS. 1A to 1C illustrate examples of processing flows in the casewhere super-resolution processing is performed after frame interpolationprocessing is performed.

FIG. 1A illustrates a processing flow in the case where super-resolutionprocessing is performed so that resolution is increased after frameinterpolation processing is performed using an image signal obtainedfrom an image source. A variety of processings are further performedafter the super-resolution processing is performed. After that, an imagecan be displayed.

Note that the image source includes a signal of TV broadcast, which istransmitted from a broadcast station, and/or an image generated from thesignal. Alternatively, the image source includes a signal obtained froman optical storage medium (including a magnetic storage medium or amagnetooptical storage medium) such as a DVD (including a Blu-ray DVD orthe like) or a CD, streaming, the Internet, or the like; and/or an imagegenerated from the signal. Alternatively, the image source includes asignal obtained from a mobile phone, a computer, a CPU, a graphicmicrocomputer, a controller, an electronic device, or the like; and/oran image generated from the signal. Alternatively, the image sourceincludes a signal used for performing display and/or an image generatedfrom the signal.

Note that the image includes a still image and/or a moving image and/ora screen image.

Note that the image source can be an interlace image or a progressive(non-interlace) image. Alternatively, the image source can be an imageon which IP conversion (interlace-progressive conversion), which isprocessing for converting interlace images into progressive images, hasalready been performed. Alternatively, IP conversion can be performedbefore and after frame interpolation processing is performed or beforesuper-resolution processing is performed. FIG. 3A illustrates part of aprocessing flow in the case where super-resolution processing isperformed on a progressive image. FIG. 3B illustrates part of aprocessing flow in the case where frame interpolation processing isperformed after IP conversion is performed on an interlace image. FIG.3C illustrates part of a processing flow in the case where frameinterpolation processing is performed after IP conversion is performedon an interlace image, and then super-resolution processing isperformed. FIG. 3D illustrates part of a processing flow in the casewhere super-resolution processing is performed after IP conversion isperformed on an interlace image.

Usually, super-resolution processing is performed on one image (or partof the image) or a plurality of images (or parts of the images). Inaddition, in the super-resolution processing, new data is generatedusing such an image so that a high-resolution image is generated.Therefore, in order to accurately perform the super-resolutionprocessing, it is not preferable that part of image data be lost as inan interlace image. Accordingly, it is preferable that an image on whichthe super-resolution processing be performed be a progressive(non-interlace) image. Thus, in the case of an interlace image, it ispreferable that IP conversion be performed before the super-resolutionprocessing is performed and the super-resolution processing be performedon a progressive image. Note that one example of this embodiment is notlimited to this.

Note that IP conversion can be performed before or aftersuper-resolution processing. Further/Alternatively, IP conversion can beperformed before or after frame interpolation processing.Further/Alternatively, IP conversion can be performed before or afterdifferent processing.

Note that as illustrated in FIG. 4A, for example, it is preferable thatthe resolution (the number of pixels) of an image subjected tosuper-resolution processing be higher than the resolution (the number ofpixels) of an image before subjected to the super-resolution processing.However, one example of this embodiment is not limited to this. Forexample, before the super-resolution processing is performed, resolution(the number of pixels) has already been high by enlargement processingor the like. In that case, since the resolution has already been high,the resolution itself is not changed before and after thesuper-resolution processing. However, in enlargement processing beforethe super-resolution processing, missing image data is not restored.That is, the image is just enlarged and display itself does not havehigh quality. For example, in the case of an image of a park where agreat number of small stones are disposed or a tree having a greatnumber of small leaves, an image of each small stone or each small leafis not accurately displayed by enlargement processing but is justenlarged in a blurred state. Thus, by performing the super-resolutionprocessing, it is possible to restore missing image data and to generatea high-quality image whose detailed parts can be recognized, though theresolution (the number of pixels) of an image is not changed. In otherwords, as illustrated in FIG. 4B, it is possible to generate an imagehaving a resolution of 1920×1080 from an image having a resolution of1440×1080 by enlargement processing and to generate an image having aresolution of 1920×1080 from the image having a resolution of 1920×1080by super-resolution processing. In this case, in the case where theimage having a resolution of 1920×1080 is generated from the imagehaving a resolution of 1440×1080 by the enlargement processing, there isno restored data. However, after the super-resolution processing isperformed, data is restored. Thus, an image whose detailed parts can beaccurately recognized can be generated.

Note that such processing is performed on the entire screen in manycases; however, one example of this embodiment is not limited to this.Such processing can be performed on part of the screen.

Note that it is possible to make resolution high by enlargementprocessing and then to make the resolution higher by super-resolutionprocessing. For example, it is possible to generate an image having aresolution of 1440×1080 from an image having a resolution of 800×600 byenlargement processing and to generate an image having a resolution of1920×1080 from the image having a resolution of 1440×1080 bysuper-resolution processing. Note that in the case of making theresolution high by the enlargement processing, data is not restored. Onthe other hand, in the case of making the resolution high by thesuper-resolution processing, data is restored. Note that one example ofthis embodiment is not limited to this.

Alternatively, it is possible to make resolution high bysuper-resolution processing and then to make the resolution higher byenlargement processing. For example, it is possible to generate an imagehaving a resolution of 1440×1080 from an image having a resolution of800×600 by super-resolution processing and to generate an image having aresolution of 1920×1080 from the image having a resolution of 1440×1080by enlargement processing. Note that in the case of making theresolution high by the enlargement processing, data is not restored. Onthe other hand, in the case of making the resolution high by thesuper-resolution processing, data is restored. Note that one example ofthis embodiment is not limited to this.

Note that enlargement processing can be performed before or aftersuper-resolution processing. Alternatively, enlargement processing canbe performed before or after frame interpolation processing.Alternatively, enlargement processing can be performed before or afterdifferent processing. Note that one example of this embodiment is notlimited to this.

Both enlargement processing and super-resolution processing can beperformed in this manner. For example, in the case where longitudinal orlateral resolution is made twice or more, preferably five times or more,it is preferable to perform both enlargement processing andsuper-resolution processing. Note that one example of this embodiment isnot limited to this.

Note that as the enlargement processing, for example, bi-linearinterpolation, bi-cubic convolution, or the like can be used. Bi-linearinterpolation is a method by which four surrounding pixels are extractedand calculated and insufficient images are interpolated in enlargement.In bi-cubic convolution, 16 pixel values (4×4 pixel values) in standardsof coordinate after conversion are extracted from a coordinate beforethe conversion. Then, weighted-average calculation is performed byweighting of the extracted 16 pixel values so that the pixel valuesafter the conversion are determined.

Note that as illustrated in FIG. 4C, whether enlargement processing isperformed on an image is analyzed. In the case where enlargementprocessing is performed on part or all of a screen, super-resolutionprocessing is performed. In the case where enlargement processing is notperformed, i.e., in the case where resolution is originally high,super-resolution processing can be omitted. Since a variety of imagesare used as image sources, by performing image analysis,super-resolution processing can be accurately performed even on an imageon which enlargement processing is performed. Note that as an example ofan image analysis method, there is a method by which frequency analysisis performed and whether frequency is high is determined. In the casewhere frequency is low, it can be determined that enlargement processinghas been performed.

Next, it is assumed that by performing super-resolution processing on animage having lateral resolution (the number of pixels) of A andlongitudinal resolution (the number of pixels) of B, the image ischanged into an image having lateral resolution (the number of pixels)of C and longitudinal resolution (the number of pixels) of D.Alternatively, it is assumed that by performing enlargement processingand the super-resolution processing on an image having the lateralresolution (the number of pixels) of A and the longitudinal resolution(the number of pixels) of B, the image is changed into an image havingthe lateral resolution (the number of pixels) of C and the longitudinalresolution (the number of pixels) of D. In this case, it can be saidthat a multiplying factor when the resolution is made higher by thesuper-resolution processing is C/A, where C is divided by A, or D/B,where D is divided by B. In addition, it is assumed that in the case ofperforming frame rate doubling, frame frequency is N times.

In this case, N>(C/A) or N>(D/B) is preferable. Alternatively, N≧(C/A)and N≧(D/B) are preferable. Note that one example of this embodiment isnot limited to this.

In the case of performing frame interpolation processing for frame ratedoubling, even when the amount of frame data to be interpolated is madelarger, data can be generated without problems. For example, FIG. 2Aillustrates double-frame rate driving; however, by adjustment of theposition of a circle as illustrated in FIG. 2B, triple-frame ratedriving can be easily realized. That is, in the frame interpolationprocessing for the frame rate doubling, even when the amount of framedata to be interpolated is made larger, big problems do not occur in animage. Alternatively, by making the amount of frame data to beinterpolated larger, moving-image characteristics can be furtherimproved and afterimages can be further reduced.

On the other hand, the super-resolution processing is processing bywhich resolution data which is lost in photographing or signaltransmitting is restored. Therefore, if a large amount of data is lost,it is difficult to restore the data adequately. Accordingly, when thevalue of (C/A) or (D/B) is too large, problems occur in an image itselfand the image is distorted.

From the above, when both frame interpolation processing andsuper-resolution processing are performed, N>(C/A) or N>(D/B) ispreferable. Alternatively, N≧(C/A) and N≧(D/B) are preferable. Thus,when both the frame interpolation processing and the super-resolutionprocessing are performed and the above relationship is satisfied, ahigh-quality image in which detailed parts are clear and afterimagefeeling is eliminated can be displayed. Note that one example of thisembodiment is not limited to this.

Note that in the case of performing frame interpolation processing, in amoving region of a screen, data is additionally generated for the frameinterpolation processing in many cases. In addition, in a static regionof the screen, data is not additionally generated in many cases. Thatis, in the screen, there are a region where data is additionallygenerated by frame interpolation processing and a region where data isnot additionally generated. For example, in the case of FIG. 2A, in aregion 301 and a region 303, data of the first frame before subjected tointerpolation and data of the second frame before subjected to theinterpolation do not change, as illustrated in FIG. 2C. Therefore, thereis no change even in frame data to be interpolated and data is notadditionally generated. Data is generated by utilizing the data of thefirst frame before subjected to the interpolation or the data of thesecond frame before subjected to the interpolation. On the other hand,in a region 302, data of the first frame before subjected to theinterpolation and data of the second frame before subjected to theinterpolation change, so that there are a region where the circle iserased and a region where the circle is generated. Thus, data isadditionally generated.

In the case of performing frame interpolation processing in this manner,in a screen, there are a region where data is additionally generated anda region where data is not additionally generated. In addition, suchregions change over time. For example, as an example of a region wheredata is generated, a region can be given in which a character isdisplayed in a ticker or the like and is moved up and down or right andleft. In the case of a character, a symbol, or the like, whenafterimages are generated and the character, the symbol, or the like isnot easily seen, it is impossible to determine the type of thecharacter, the symbol, or the like, which is a big problem.

Generation of additional data only in parts of regions in a screen whenframe interpolation processing is performed in this manner hasadvantages such as improvement in processing speed, reduction in powerconsumption, and improvement in processing accuracy.

Further, super-resolution processing can be performed not on all regionsin a screen but on parts of the regions in the screen. For example, inthe case where a streaming broadcast is displayed on part of a screen, alow-resolution image is displayed on only in that region while beingenlarged in some cases. In such a case, by performing super-resolutionprocessing on only the region where the streaming broadcast isdisplayed, image quality can be improved.

In the case of performing super-resolution processing only on parts ofregions in a screen in this manner, there is an advantage such asimprovement in processing speed, reduction in power consumption,improvement in processing accuracy, or reduction in image defects.

Therefore, in a screen, there are a first region where data isadditionally generated for frame interpolation processing and a secondregion where super-resolution processing is performed. Further, a thirdregion where data is not additionally generated for frame interpolationprocessing and super-resolution processing is not performed can beprovided. Furthermore, a region where the first region and the secondregion do not overlap with each other can be provided in the screen.Alternatively, a region where the first region and the second regionoverlap with each other can be provided in the screen.

Data is additionally generated for frame interpolation processing in aregion where data related to a character or a symbol, such as a tickerin many cases. Super-resolution processing is performed on a region withlittle motion in many cases. Therefore, in the screen, it is preferablethat the region be provided in which the first region where data isadditionally generated for the frame interpolation processing does notoverlap with the second region where the super-resolution processing isperformed. The reason for this is as follows. Since the first regionwhere data is additionally generated for the frame interpolationprocessing is a moving region, data is additionally generated for theframe interpolation processing in order to make afterimages invisible.However, in such a moving region, even if resolution is made higher bysuper-resolution processing, it may be difficult for eyes to recognizethe resolution. Therefore, in such a moving region, it can be said thatsuper-resolution processing is not performed in some cases. The secondregion where the super-resolution processing is performed is a regionwhose detailed parts are preferably seen clearly. In the case where astatic image such as a still image is displayed, it can be said thatdetailed parts are seen clearly. Since there is a possibility ofoccurrence of the above condition, a region can be provided in which afirst region where both frame interpolation processing andsuper-resolution processing are performed, the screen can be displayedwith advantages of both of the processings, and data is additionallygenerated for the frame interpolation processing does not overlap withthe second region where the super-resolution processing is performed.Accordingly, an appropriate image can be displayed. Note that oneexample of this embodiment is not limited to this.

By performing both frame interpolation processing and super-resolutionprocessing in this manner, images having high image picture resolutionand high moving image resolution can be displayed.

Note that in the case where super-resolution processing is performedafter frame interpolation processing is performed, frame frequency ismade higher for the frame interpolation processing. Therefore,processing speed of the super-resolution processing is not sufficientlyhigh in some cases. Thus, a plurality of processing systems for thesuper-resolution processing can be provided. For example, FIG. 1Billustrates the ease where two processing systems for thesuper-resolution processing are provided. Further, FIG. 1C illustratesthe case where three processing systems for the super-resolutionprocessing are provided. In a similar manner, any processing system canbe provided.

In the case where a plurality of processing systems are provided,processings can be divided among the processing systems by a variety ofmethods. For example, processing for a right half of a screen can beperformed by a first super-resolution processing system, and processingfor a left half of the screen can be performed by a secondsuper-resolution processing system. Since image data related to an imageis usually transferred in each row, processings can be divided betweenthe first super-resolution processing system and the secondsuper-resolution processing system by division of image data for one rowinto two pieces of data for the right half and left half of the screen.Note that one example of this embodiment is not limited to this.

Alternatively, processing of a certain frame (e.g., an odd-numberedframe or a frame on which frame interpolation processing is notperformed) can be performed by the first super-resolution processingsystem, and processing of a different frame (e.g., an even-numberedframe or a frame generated by frame interpolation processing) can beperformed by the second super-resolution processing system. Thus, evenwhen the processing speed of the super-resolution processing is lowerthan the frame frequency, processing can be completed normally byalternate processings. Alternatively, since the processing speed of oneprocessing system may be low, power consumption can be reduced.

Note that one example of this embodiment is not limited to the casewhere super-resolution processing is performed after frame interpolationprocessing is performed. For example, as illustrated in FIG. 5A,super-resolution processing can be performed while performing frameinterpolation processing. First, image data A is supplied from an imagesource. The image data A is not image data generated by the frameinterpolation processing but original image data. Therefore, thesuper-resolution processing can be performed immediately. Next, imagedata B is supplied from the image source. Then, frame data isinterpolated using the image data A and the image data B which havealready been supplied. When the frame interpolation processing isperformed using the image data A and the image data B, thesuper-resolution processing can be performed using the image data A.That is, the image data A is used for both of the frame interpolationprocessing and the super-resolution processing. Thus, thesuper-resolution processing and the frame interpolation processing canbe performed concurrently. After that, by the frame interpolationprocessing with the use of the image data A and the image data B, imagedata C is generated. Then, super-resolution processing is performed onthe image data C obtained by the frame interpolation with the use of theimage data A and the image data B. By concurrently performing the frameinterpolation processing and the super-resolution processing in thismanner, the number of memories for storing the image data A can bereduced. When the image data A is stored in one memory, thesuper-resolution processing and the frame interpolation processing canbe performed by reading of the data. Note that as for image data whereframe data is generated, it can be said that the super-resolutionprocessing is performed after the frame interpolation processing isperformed. Note that one example of this embodiment is not limited tothis.

Note that as in FIG. 1B, a plurality of processing systems can beprovided for super-resolution processing, and the super-resolutionprocessing and frame interpolation processing can be performedconcurrently. FIG. 5B illustrates an example of such a case. Forexample, the super-resolution processing is performed on at least theimage data A by using the second super-resolution processing system.Concurrently, the frame interpolation processing is performed using atleast the image data A. That is, the frame interpolation processing andthe super-resolution processing are concurrently performed using atleast the image data A. After that, the super-resolution processing isperformed on image data on which frame interpolation is performed usingthe first super-resolution processing system. By providing a pluralityof super-resolution processing systems in this manner, processings canbe performed concurrently. Further, the super-resolution processing canbe performed quickly on frame data which is not generated by the frameinterpolation with the use of the second super-resolution processingsystem. Therefore, when image data is input, display can be performedquickly. Accordingly, such processing is preferable in the case ofdisplaying an image of a game or the like, where real-time processing isneeded. Note that one example of this embodiment is not limited to this.

Note that in the case where a plurality of processings are performedconcurrently, the processings can be performed concurrently only in partof the processing period of each processing. In other words, even in thecase where a plurality of processings are performed concurrently, aperiod during which the plurality of processings are not performedconcurrently can be provided. Alternatively, the plurality ofprocessings can be performed concurrently in all the processing periodof each processing.

Alternatively, processing may be performed as in FIG. 5C. For example,super-resolution processing is performed on at least the image data A byusing the first super-resolution processing system or the secondsuper-resolution processing system. Concurrently, the frameinterpolation processing is performed using at least the image data A.That is, the frame interpolation processing and the super-resolutionprocessing are concurrently performed using at least the image data A.After that, the super-resolution processing is performed on image dataon which frame interpolation is performed using the secondsuper-resolution processing system or the first super-resolutionprocessing system. By providing a plurality of super-resolutionprocessing systems in this manner, processings can be performedconcurrently. Further, the super-resolution processing can be performedquickly on frame data which is not generated by the frame interpolationwith the use of the first super-resolution processing system or thesecond super-resolution processing system. Therefore, when image data isinput, the image can be displayed quickly. Accordingly, such processingis preferable in the case of displaying an image of a game or the like,where real-time processing is needed. Note that one example of thisembodiment is not limited to this.

Note that FIGS. 1A to 1C, FIGS. 3A to 3D, FIGS. 4A to 4C, and FIGS. 5Ato 5C illustrate the processing flows as examples, and FIG. 6Aillustrates an example of a structure (a block diagram) for realizingthe processing flows. For example, an image source is input to an inputterminal of a circuit 101. An output terminal of the circuit 101 isconnected to an input terminal of the circuit 102. For example, thecircuit 101 has a function of performing frame interpolation processing.For example, the circuit 102 has a function of performingsuper-resolution processing. The circuit 101 or the circuit 102 caninclude a memory circuit (a memory) for storing data. Alternatively, thecircuit 101 or the circuit 102 can include a unit for calculation.

FIG. 6B illustrates another example of a structure (a block diagram) forrealizing the processing flows. FIG. 6B corresponds to FIG. 1B. Forexample, an image source is input to the input terminal of the circuit101. The output terminal of the circuit 101 is connected to an inputterminal of a circuit 102 a through a switch 103 a. Further, the outputterminal of the circuit 101 is connected to an input terminal of acircuit 102 b through a switch 103 b. An output terminal of the circuit102 a is connected to an output terminal through a switch 104 a.Further, an output terminal of the circuit 102 b is connected to theoutput terminal through a switch 104 b. Note that as illustrated in FIG.6C, the switch 103 b can be connected between the input terminal of thecircuit 102 b and the input terminal of the circuit 101. Note that FIG.6C corresponds to FIG. 5B. The circuit 101 has a function of performingframe interpolation processing. Each of the circuit 102 a and thecircuit 102 b has a function of performing super-resolution processing.The circuit 101 or the circuit 102 can include a memory circuit (amemory) for storing data. Alternatively, the circuit 101 or the circuit102 can include a unit for calculation. By controlling the switch 103 a,the switch 103 b, the switch 104 a, and/or the switch 104 b, processingscan be performed concurrently.

Note that in the circuit 101, the circuit 102, the circuit 102 a, and/orthe circuit 102 b can realize its function with hardware, software, orboth hardware and software. When the circuit 101 and/or the circuit 102realizes its function with hardware, processing speed can be made higheror power consumption can be reduced. When the circuit 101 and/or thecircuit 102 realizes its function with software, the content ofprocessing can be changed and a variety of processings can be performedas appropriate.

Alternatively, by using a multi-core CPU including a plurality of CPUcores and distributing processings across the CPU cores, a plurality ofsuper-resolution processings or frame interpolation processings can beperformed. With the use of a multi-core CPU in this manner, high-speedoperation is possible with fewer components. Note that such a multi-coreCPU can include a semiconductor device (or a transistor) formed using anSOI. With the use of an SOI, operation can be performed with low powerconsumption and heat generation during the operation can be suppressed.

Note that even when the number of processings is increased, a circuitcan be formed in a manner similar to those in FIGS. 6A to 6C byincreasing a circuit such as the circuit 101, the circuit 102, thecircuit 102 a, or the circuit 102 b. Note that processing performed inthe circuit 101, the circuit 102, the circuit 102 a, or the circuit 102b is not limited to super-resolution processing or frame interpolationprocessing. A variety of different processings can be performed.

Note that in the contents described thus far and/or contents describedbelow, simple enlargement processing or the like can be performedinstead of super-resolution processing.

Embodiment 2

Next, examples of super-resolution processing technologies aredescribed. By performing super-resolution processing, a high-resolutionimage can be displayed.

First, a moving region is detected and speed data of the region isextracted. That is, with respect to an image at given time, an opticalflow, which is a vector illustrating the flow of each pixel, iscalculated from two images before and after the image. Then, from theextracted speed data, the amount of positional deviation per image inthe region is detected with accuracy of less than the size of one pixel.That is, from the calculated optical flow, the amount of positionaldeviation between images is calculated. Then, in accordance with theamount of detected positional deviation, the level of luminance betweenpixels is interpolated from a plurality of images in an image column.With such processing, a high-resolution image having resolution which ishigher than physical resolution can be generated. Thus, it can be saidthat the super-resolution processing technology is a technology by whichdata for restoring a high-resolution image is extracted and restoredfrom a low-resolution image in accordance with motion vector data or thelike.

In a similar super-resolution processing technology, for example, first,consecutive frames having close correlation are selected from images.After that, the motion vector of the images are detected with finenesswhich is close to the size of one pixel. Then, the motion of each pixelis tracked, and a missing high-resolution pixel is estimated from datarelated to a change in the tracked pixel between respective frames. Inthis case, since a camera slightly swings, crushing of a photographedlow-resolution portion is varied between the frames, though the sameportion is photographed. Thus, with this data, the missing pixel can becompensated and high resolution can be realized. That is, it can be saidthat this processing method is a super-resolution technology by whichsearch is performed sufficiently in a time direction. In the case ofthis super-resolution technology, motion vectors can be recognizedprecisely. Thus, a missing pixel between frames, which cannot beacquired in photographing due to the resolution of a camera, can also berestored.

Alternatively, in different super-resolution processing, the similarityof a plurality of frames is found out. After that, the frames havingsimilarity are aligned, and a time change in each pixel is recognized.Then, a method by which a missing high-resolution pixel is estimated andgenerated can be used.

Alternatively, in different super-resolution processing, first, datarelated to a consecutive plurality of images is analyzed. Then, ahigh-frequency component is restored by correction of common portions ofphotographic objects. Thus, a high-resolution image can be obtained.

Alternatively, as different super-resolution processing, areconstruction super-resolution processing method can be used. In thereconstruction super-resolution processing method, first,high-resolution images (initial high-resolution images) are assumed fromoriginal low-resolution images. Then, in accordance with a point spreadfunction (PSF) obtained from the model of a camera, the pixel values ofall the pixels of the low-resolution images are estimated from theassumed high-resolution images. In other words, the assumedhigh-resolution images are down-converted by a unique function (animaging model function) so that low-resolution images having the sameresolution as the original low-resolution images are generated. Then, adifference between the estimated value and an observed pixel value (anobserved value) is calculated. After that, with respect to the imagesbefore subjected to down conversion, high-resolution images in which theabove difference is smaller are searched. Note that this searchprocessing can be repeated until convergence so that accuracy is madehigher, or can be performed only once. Thus, high-resolution images canbe obtained.

Note that as the imaging model function, for example, an imaging elementmodel where processing is performed two-dimensionally (lengthwise andwidthwise) by using a one-dimensional linear filter can be used.

In the case of this reconstruction super-resolution processing method,high-resolution images are reconstructed by iterative calculation whichneeds initial high-resolution images. As a calculation method in thatcase, an ML (maximum-likelihood) method, a MAP (maximum a posterior)method, a POCS (projection on to convex sets) method, or the like can beused.

In the ML method, a square error between an estimated pixel value of anassumed high-resolution image and a pixel value which is actuallyobserved is used as an evaluation function. In the ML method, ahigh-resolution image in which the evaluation function is minimized isused as an estimated image.

The MAP method is a method by which a high-resolution image in which anevaluation function where the probability information of ahigh-resolution image is added to a square error is minimized isestimated. In other words, the MAP method is a super-resolutionprocessing method by which a high-resolution image is estimated as anoptimization problem for maximizing posterior probability by utilizingforeseeing data related to a high-resolution image.

The POCS method is a method by which a simultaneous equation of pixelvalues of a high-resolution image and a low-resolution image is formedand sequentially solved.

Note that one frame is formed by merging a plurality of frames of animage. Thus, the image is made to have higher resolution by the increasein the number of pixels. In this case, processing for making resolutionhigher can be performed such that a return component is canceled.

Alternatively, as a super-resolution processing method, an iterationmethod, a frequency-domain method, a statistical method, or the like canbe used. The iteration method mainly includes three steps: a first stepof initial estimation, a second step of imaging, and a third step ofreconstructing.

Note that super-resolution processing can be performed on the wholescreen. However, one example of this embodiment is not limited to this.The super-resolution processing can be performed depending on thecontent of an image. For example, the super-resolution processing is notperformed on an edge portion or a flat portion of an image but thesuper-resolution processing can be performed on a textual portion of theimage. In that case, real-time spectrum analysis is performed on theimage. In addition, the super-resolution processing can be performed ononly a high-frequency region. By controlling whether thesuper-resolution processing is performed or not depending on an image,the image can be prevented from deteriorating.

Note that the flat portion is a portion where regions having specificfrequency or regions having specific luminance are highly distributed.Thus, a sky whose color distribution is comparatively gradual, a dimbackground, or the like corresponds to the flat portion. Therefore, itcan be said that the flat portion is a region whose color is mainlyexpressed gradationally in an image.

Note that the textual portion is a high-frequency portion of an image.Since this region has high frequency, it is highly possible that a moredetailed portion exist. Therefore, by performing the super-resolutionprocessing on the textural portion, it can be said that the increase inresolution is highly effective.

Note that in the case of performing super-resolution processing,resolution of a variety of regions of an image is recognized andsuper-resolution processing can be performed on each region at differentintensity.

Note that if the resolution of an original image is sufficiently high,super-resolution processing can be omitted. After determining whetherthe resolution of the original image is high, whether super-resolutionprocessing is performed can be controlled depending on the result.

Although a variety of super-resolution processing technologies have beendescribed above, the super-resolution processing technology in thisspecification is not limited to them.

Embodiment 3

Note that an image can be displayed by performing a variety ofprocessings after super-resolution processing or frame interpolationprocessing. Therefore, the content described in any of the otherembodiments can be applied to, combined with, or replaced with thisembodiment.

FIG. 7A illustrates a processing flow in the case where super-resolutionprocessing is performed using an image signal on which frameinterpolation processing is performed so that resolution is increased,and then edge enhancement processing is performed. A variety ofprocessings are further performed after the edge enhancement processing.After that, an image can be displayed. Therefore, the processing flow inFIG. 7A corresponds to a processing flow where edge enhancementprocessing is added to the processing flow in FIG. 1A.

By performing super-resolution processing before edge enhancementprocessing in this manner, resolution can be accurately improved. Sincethe edge enhancement processing is not performed on an image beforesubjected to the super-resolution processing, unnecessary processing isnot performed. If the edge enhancement processing is performed beforethe super-resolution processing, processing is performed on an image bythe edge enhancement processing. When such an image on which theprocessing is performed is used, there is a possibility that thesuper-resolution processing cannot be accurately performed. Since thesuper-resolution processing is processing for generating a newhigh-resolution image, in order to generate a high-resolution imageaccurately, it is preferable to perform the super-resolution processingon an image on which the edge enhancement processing is not performed,i.e., an image which is close to an original image. Therefore, byperforming the super-resolution processing before the edge enhancementprocessing, the super-resolution processing can be accurately performed.By performing the edge enhancement processing on a more accuratehigh-resolution image which is generated by the super-resolutionprocessing, the edge of an object in the image can be more accuratelyacquired, so that a clearer image can be obtained. Accordingly, in orderto obtain a high-quality image, it is preferable to perform thesuper-resolution processing before the edge enhancement processing isperformed. Note that one example of this embodiment is not limited tothis.

In a similar manner, by performing the frame interpolation processingbefore the edge enhancement processing is performed, data for frameinterpolation can be accurately generated. By performing the edgeenhancement processing on a more accurate high-resolution image, theedge of an object in the image can be more accurately acquired, so thata clearer image can be obtained.

Note that as for the edge enhancement processing, one example of thisembodiment is not limited to the above example. Different imageprocessing can be performed. As different image processing, for example,smoothing, distortion correction, error processing, flaw correction,color correction, gamma correction, inverse gamma correction, or thelike can be performed instead of or in addition to the edge enhancementprocessing. For example, by color correction, an image with 100% or lessNTSC ratio can be converted into an image with 100% or more NTSC ratio.Thus, an image having high color impurity can be displayed.

Note that a plurality of image processings such as edge enhancementprocessing are performed, the processings can be performed successively.However, one example of this embodiment is not limited to this. Theplurality of processings can be separately performed. For example,certain image processing can be performed before processing A anddifferent image processing can be performed after processing B.

Note that the content or the drawing described in Embodiment 1 can beapplied to the case where different processing such as edge enhancementprocessing is performed in a similar manner. In a similar manner, thecontent or the drawing described in certain processing can be applied tothe case where different processing is performed.

For example, FIG. 7B illustrates a processing flow in the case where aplurality processing systems are provided for super-resolutionprocessing. The processing flow in FIG. 7B corresponds to a processingflow where edge enhancement processing is added to the processing flowin FIG. 1B. Note that edge enhancement processing can be applied to adifferent processing flow in a similar manner.

Note that before and after each stage in the processing flow, a varietyof different processings can be performed. As examples of a variety ofdifferent processings, there are IP conversion processing, enlargementprocessing, and the like. Further, another processing is possible.

Next, in a manner similar to that of the case where edge enhancementprocessing is performed, FIG. 7C illustrates a processing flow in theease where overdrive processing is performed as processing performedafter super-resolution processing. Therefore, the content or the drawingdescribed in the edge enhancement processing can be applied to the casewhere different processing such as overdrive processing is performed ina similar manner. In a similar manner, the content or the drawingdescribed in certain processing can be applied to the case wheredifferent processing is performed.

The overdrive processing is processing for making the response speed ofa liquid crystal element higher. Usually, a signal corresponding to agray level which is to be expressed in each pixel is supplied to eachpixel in a screen. However, since the liquid crystal element has lowresponse speed, even if a signal corresponding to a gray level issupplied, display which corresponds to the gray level cannot beperformed in one frame period. After several frame periods, displaywhich corresponds to the gray level is eventually performed. Thus, insupplying voltage to the liquid crystal element, not voltagecorresponding to an original gray level but voltage having largeramplitude is supplied to the liquid crystal element. Accordingly, thetransmittance of the liquid crystal element is drastically changed.After that, voltage corresponding to the original gray level issupplied. Through the above operation, the response speed of the liquidcrystal element can be made higher. Driving by which voltage havinglarger amplitude than voltage corresponding to the original gray levelis temporarily supplied to the liquid crystal element before the voltagecorresponding to the original gray level is supplied is referred to asoverdrive. Further, processing for determining which level of voltage issupplied as voltage having larger amplitude than voltage correspondingto the original gray level is referred to as overdrive processing.

By performing overdrive processing after super-resolution processing isperformed, response speed can be made higher, the amount of overdrivecan be controlled adequately, and display with fewer afterimages can beperformed. Alternatively, since the super-resolution processing isprocessing by which a new image is generated, an image is changed by theprocessing. Thus, the gray level of each pixel is changed. Therefore, byperforming the overdrive processing after the super-resolutionprocessing is performed, the overdrive processing can be changed inaccordance with the amount of change generated by the super-resolutionprocessing. Accordingly, by performing the overdrive processing afterthe super-resolution processing is performed, the amount of overdrivecan be controlled adequately, so that the gray level of each pixel canbe optimized. Thus, the response speed can be made higher and theoverdrive can be accurately performed. Further, by the super-resolutionprocessing, a high-resolution image can be displayed without generationof afterimages. Accordingly, in order to obtain a high-quality image, itis preferable to perform the super-resolution processing before theoverdrive processing is performed. Note that one example of thisembodiment is not limited to this.

Note that here, the amount of overdrive corresponds to an increase involtage supplied to a liquid crystal element or the like, which is anincrease in the amplitude of the voltage by overdrive processing.

In a similar manner, by performing overdrive processing after frameinterpolation processing is performed, response speed can be madehigher, the amount of overdrive can be controlled adequately, anddisplay with fewer afterimages can be performed. Alternatively, sincethe frame interpolation processing is processing for generating newframe data, an image which is changed is generated by the processing.Thus, the gray level of each pixel is changed. Therefore, by performingthe overdrive processing after the frame interpolation processing isperformed, the overdrive processing can be changed in accordance withthe amount of change generated by the frame interpolation processing.Accordingly, by performing the overdrive processing after the frameinterpolation processing is performed, the amount of overdrive can becontrolled adequately, so that the gray level of each pixel can beoptimized. Thus, the response speed can be made higher and the overdrivecan be accurately performed. Further, by the frame interpolationprocessing, display with fewer afterimages can be performed.Accordingly, in order to obtain a high-quality image, it is preferableto perform the frame interpolation processing before the overdriveprocessing is performed. Note that one example of this embodiment is notlimited to this.

Note that on a moving region of a screen, overdrive processing isperformed in many cases. In addition, on a static region of the screen,overdrive processing is hardly performed because afterimages are notgenerated. That is, in the screen, there are a region where overdriveprocessing is performed and a region where overdrive processing is notperformed. In addition, such regions change over time. In the case ofperforming overdrive processing only on parts of regions in a screen inthis manner, there is an advantage such as improvement in processingspeed, reduction in power consumption, or improvement in processingaccuracy.

Further, super-resolution processing can be performed not on all regionsin a screen but on parts of the regions in the screen. In the case ofperforming super-resolution processing only on parts of regions in ascreen in this manner, there is an advantage such as improvement inprocessing speed, reduction in power consumption, improvement inprocessing accuracy, or reduction in image defects.

In the case where processing is performed on parts of regions in ascreen, in the screen, there are a first region where overdriveprocessing is performed and a second region where super-resolutionprocessing is performed. Further, a third region where neither of theprocessings is performed can be provided. Furthermore, a region wherethe first region and the second region do not overlap with each othercan be provided in the screen. Alternatively, a region where the firstregion and the second region overlap with each other can be provided inthe screen.

Thus, the region is considered in which the first region where theoverdrive processing is performed does not overlap with the secondregion where the super-resolution processing is performed. In this case,since the first region where the overdrive processing is performed is amoving region, the overdrive processing is performed in order to makeafterimages invisible. However, in such a moving region, even ifresolution is made higher by super-resolution processing, it may bedifficult for eyes to recognize the resolution. Therefore, in such amoving region, super-resolution processing is not performed in somecases. Accordingly, in that case, it can be said that the region inwhich the first region where the overdrive processing is performed doesnot overlap with the second region where the super-resolution processingis performed is provided in some cases. Further in that case, the secondregion where the super-resolution processing is performed is a regionwhose detailed parts are preferably seen clearly. In the case where astatic image such as a still image is displayed, detailed parts can beseen clearly. Accordingly, it can be said that the region in which thefirst region where the overdrive processing is performed does notoverlap with the second region where the super-resolution processing isperformed is provided in some cases.

In the region in which the first region where the overdrive processingis performed overlaps with the second region where the super-resolutionprocessing is performed, response speed is high, an image with fewerafterimages is displayed, and detailed parts can be seen clearly. Thus,a realistic image can be displayed.

Thus far, the case has been described in which edge enhancementprocessing or overdrive processing is performed after super-resolutionprocessing; however, processing performed after the super-resolutionprocessing is not limited to this. In a manner similar to the case ofperforming edge enhancement processing or overdrive processing, localdimming processing of a backlight can be performed aftersuper-resolution processing. FIG. 7D illustrates a processing flow ofsuch a case. Therefore, the content or the drawing described in the edgeenhancement processing or the overdrive processing can be applied to thecase where local dimming processing of a backlight is performed in asimilar manner. In a similar manner, the content or the drawingdescribed in the local dimming processing of a backlight can be appliedto the case where different processing is performed.

Here, the local dimming of a backlight is a technique by which displayis performed with the luminance of a backlight changed in each region ina screen. Therefore, depending on an image, the luminance of thebacklight is varied in each region in one screen. For example, in thecase where there is a region for displaying a low gray level in ascreen, the luminance of a backlight in the region is made lower.Further, in the case where there is a region for displaying a high graylevel in the screen, the luminance of the backlight in the region ismade higher. Then, the transmittance of each pixel is determined inaccordance with the luminance of the backlight so that an accurate imagecan be displayed. Thus, in the region for displaying a low gray level inthe screen, the luminance of the backlight itself is low, so thatadverse effects of light leakage can be reduced. Therefore, in the caseof displaying a black image in such a region, the image can be displayedas a completely black image. In addition, in the region for displaying ahigh gray level in the screen, the luminance of the backlight itself ishigh, so that sufficiently bright display can be performed. Therefore,in the case of displaying a white image in such a region, luminance ismade higher than that in the case of displaying a normal white image,and the image can be displayed with higher peak luminance. Accordingly,contrast can be improved and a clear image can be displayed. Further,since the luminance of the backlight itself can be made lower by localdimming, power consumption can be reduced. Thus, in order to performlocal dimming, there are processing for determining the luminance of abacklight in each region depending on an image to be displayed andprocessing for determining the transmittance of each pixel in accordancewith the luminance of the backlight so that the image to be displayedcan be accurately displayed. These processings or one of theseprocessings is referred to as local dimming processing. Therefore, inthe local dimming processing, after processing for determining theluminance of a backlight in each region is performed, processing fordetermining a video signal supplied to each pixel can be performed. Notethat one example of this embodiment is not limited to this. Thus, forexample, a processing flow in the case where the processing fordetermining the luminance of a backlight in each region and theprocessing for determining a video signal supplied to each pixel areseparately described can be illustrated as in FIG. 7E.

It is preferable that local dimming processing be performed aftersuper-resolution processing is performed in this manner. When thesuper-resolution processing is performed, due to restoration of data,new data is added. Thus, the gray level of each pixel is differentbefore and after the super-resolution processing in some cases.Alternatively, before and after the super-resolution processing, thereis a region where the gray level of a pixel is changed in a screen.Thus, by performing the local dimming after image data is restored bythe super-resolution processing, the local dimming processing can beaccurately performed. Therefore, contrast can be improved and anaccurate image can be displayed. Accordingly, in order to obtain ahigh-quality image, it is preferable to perform the super-resolutionprocessing before the local dimming processing is performed.Alternatively, in the local dimming processing, it is preferable toperform the super-resolution processing before the processing fordetermining the luminance of a backlight is performed. Alternatively, inthe local dimming processing, it is preferable to perform thesuper-resolution processing before the processing for determining avideo signal supplied to a pixel is performed. Note that one example ofthis embodiment is not limited to this.

Further, in the case of performing the local dimming processing, theluminance of the backlight is low. Thus, even when the transmittance ofthe pixel is slightly changed, the gray level of actual display is notchanged so much. On the other hand, in a state where the luminance ofthe backlight is low, a more detailed gradation can be expressed by thechange in the transmittance of the pixel. That is, the number of graylevels to be displayed can be increased. Therefore, by performing boththe local dimming processing and the super-resolution processing, ahigh-resolution image can be displayed with high power of expression, bywhich detailed parts can be perceived. In particular, gradation can beexpressed adequately in a region of a low gray level in the screen, anddisplay where gradation is crushed can be prevented.

Note that in a region where a gray level is low in a screen, localdimming processing is performed in many cases. In addition, in a regionwhere a gray level is high in the screen, i.e., a region where luminanceis high and bright display is performed, local dimming processing israrely performed because the luminance of a backlight is not easilylowered. That is, in the screen, there are a region where local dimmingprocessing is performed and a region where local dimming processing isnot performed. In addition, such regions change over time. In the caseof performing local dimming processing only on parts of regions in ascreen in this manner, there is an advantage such as improvement inprocessing speed, reduction in power consumption, or improvement inprocessing accuracy.

Further, super-resolution processing can be performed not on all regionsin a screen but on parts of the regions in the screen. In the case ofperforming super-resolution processing only on parts of regions in ascreen in this manner, there is an advantage such as improvement inprocessing speed, reduction in power consumption, improvement inprocessing accuracy, or reduction in image defects.

In the case where processing is performed on parts of regions in ascreen, in the screen, there are a first region where local dimmingprocessing is performed and the luminance of a backlight is lowered anda second region where super-resolution processing is performed. Further,a third region where neither the local dimming processing nor the superresolution processing is performed can be provided. Furthermore, aregion in which the first region where the local dimming processing isperformed and the luminance of the backlight is lowered does not overlapwith the second region where the super-resolution processing isperformed can be provided in the screen. Alternatively, a region wherethe first region and the second region overlap with each other can beprovided in the screen.

In the region in which the first region where the local dimmingprocessing is performed and the luminance of the backlight is loweredoverlaps with the second region where the super-resolution processing isperformed, contrast is high, an image can be displayed with smoothgradation expression, and detailed parts of the image can be clearlyseen. Thus, a realistic image can be displayed.

Note that in the case of performing local dimming, a screen is dividedinto a plurality of regions, and a backlight is provided in each region.When the length (or the width) of the region or the pitch of the regionis compared to the length (or the width) or the pitch of a pixelincluded in a display device in which super-resolution processing isperformed on parts of the regions of the screen and which displays aregion of a higher-resolution image, the length (or the width) of theregion of the backlight or the pitch of the region is preferably longerthan the length (or the width) or the pitch of the pixel included in thedisplay device in which the super-resolution processing is performed onparts of the regions of the screen and which displays the region of ahigher-resolution image. This is because in the case of performing thelocal dimming, an image is displayed by controlling not only theluminance of the backlight provided in each region but also thetransmittance of the pixel. Therefore, even in the case of displaying animage on which super-resolution processing is performed, ahigh-resolution image can be clearly displayed sufficiently when thepitch of each pixel is short, though the length (or the width) or thepitch of the region of the backlight is long.

Note that it is preferable that the screen be divided into a pluralityof regions where the luminance of the backlight is controlled; however,one example of this embodiment is not limited to this. The luminance ofthe entire screen can be controlled without division of the screen intoa plurality of regions.

In a similar manner, it is preferable that local dimming processing beperformed after frame interpolation processing is performed. Since theframe interpolation processing is processing for generating new framedata, an image which is changed is generated by the processing. Thus,the gray level of each pixel is changed. Alternatively, before and afterthe frame interpolation processing, there is a region where the graylevel of a pixel is changed in a screen. Therefore, by performing localdimming processing after new frame data is generated by frameinterpolation processing, the local dimming processing can be accuratelyperformed. Thus, contrast can be improved and an accurate image can bedisplayed. Accordingly, in order to obtain a high-quality image, it ispreferable to perform the frame interpolation processing before thelocal dimming processing is performed. Alternatively, in the localdimming processing, it is preferable to perform the frame interpolationprocessing before processing for determining the luminance of abacklight is performed. Alternatively, in the local dimming processing,it is preferable to perform the frame interpolation processing beforeprocessing for determining a video signal supplied to a pixel isperformed. Note that one example of this embodiment is not limited tothis.

In each of FIGS. 7A to 7D, the case is described in whichsuper-resolution processing, frame interpolation processing, anddifferent processing (e.g., edge enhancement processing, overdriveprocessing, or local dimming processing of a backlight) are performed.Note that one example of this embodiment is not limited to this. Inaddition to the above processings, processing such as edge enhancementprocessing, overdrive processing, or local dimming processing of abacklight can be performed. Therefore, in a similar manner, any of thecontents or the drawings described thus far can be applied to the casewhere different processing is further performed.

For example, FIGS. 8A and 8B each illustrate a processing flow in thecase where different processing is performed in addition tosuper-resolution processing, frame interpolation processing, and edgeenhancement processing. That is, the processing flows illustrated inFIGS. 8A and 8B each correspond to a processing flow where differentprocessing is added to the processings illustrated in FIG. 7A and FIG.1A. Note that one example of this embodiment is not limited to this.

FIG. 8A illustrates a processing flow in the case where frameinterpolation processing is performed using an image signal obtainedfrom an image source so that frame frequency is made higher,super-resolution processing is performed so that resolution isincreased, edge enhancement processing is performed, and then overdriveprocessing is performed. Therefore, the processing flow in FIG. 8Acorresponds to a processing flow where edge enhancement processing isadded to the processing flow in FIG. 7C. The processing flow in FIG. 8Acorresponds to a processing flow where edge enhancement processing andoverdrive processing are added to the processing flow in FIG. 1A.

Note that a variety of processings are further performed after theoverdrive processing is performed. After that, an image can bedisplayed.

Note that as in FIG. 1B, FIG. 1C, FIG. 5B, FIG. 5C, FIG. 7B, or thelike, super-resolution processing can be performed using a plurality ofprocessing systems. FIGS. 9A and 9B illustrate examples of such a case.

By performing super-resolution processing before edge enhancementprocessing is performed as in FIG. 8A, FIG. 9A, FIG. 9B, or the like,resolution can be accurately improved. Since the edge enhancementprocessing is not performed on an image before subjected to thesuper-resolution processing, unnecessary processing is not performed.Therefore, the super-resolution processing can be accurately performed.

In a similar manner, since the frame interpolation processing isperformed before the edge enhancement processing is performed, data forframe interpolation can be accurately generated. By performing the edgeenhancement processing on a more accurate high-resolution image, theedge of an object in the image can be more accurately acquired, so thata clearer image can be obtained.

By performing overdrive processing after super-resolution processing,edge enhancement processing, and frame interpolation processing areperformed, response speed can be made higher, the amount of overdrivecan be controlled adequately, and display with fewer afterimages can beperformed. Alternatively, since frame frequency is made higher by frameinterpolation processing, overdrive processing can be changed inaccordance with an increase in frame frequency. Alternatively, the graylevel of each pixel is changed in accordance with a change in an imageby super-resolution processing, edge enhancement processing, and frameinterpolation processing; thus, overdrive processing can be changed inaccordance with the amount of a change in gray level. Therefore, byperforming the overdrive processing after the super-resolutionprocessing, the edge enhancement processing, and the frame interpolationprocessing are performed, the amount of overdrive can be controlledadequately, so that the gray level of each pixel can be optimized. Thus,the response speed can be made higher and the overdrive can beaccurately performed. Further, by the super-resolution processing, ahigh-resolution image can be displayed without generation ofafterimages. Furthermore, by the edge enhancement processing, asharply-defined image can be displayed. Alternatively, by the frameinterpolation processing, afterimages can be reduced and moving imagescan be accurately displayed. Accordingly, in order to obtain ahigh-quality image, it is important to perform the super-resolutionprocessing, the edge enhancement processing, and the frame interpolationprocessing before the overdrive processing is performed. Note that oneexample of this embodiment is not limited to this.

FIG. 8B illustrates a processing flow in the case where frameinterpolation processing is performed using an image signal obtainedfrom an image source so that frame frequency is made higher,super-resolution processing is performed so that resolution isincreased, edge enhancement processing is performed, and then localdimming processing is performed. Therefore, the processing flow in FIG.8B corresponds to a processing flow where edge enhancement processing isadded to the processing flow in FIG. 7D.

Note that a variety of processings are further performed after the localdimming processing is performed. After that, an image can be displayed.

By performing super-resolution processing before edge enhancementprocessing is performed in this manner, resolution can be accuratelyimproved. Since the edge enhancement processing is not performed on animage before subjected to the super-resolution processing, unnecessaryprocessing is not performed. Therefore, the super-resolution processingcan be accurately performed.

In a similar manner, since the frame interpolation processing isperformed before the edge enhancement processing is performed, data forframe interpolation can be accurately generated. By performing the edgeenhancement processing on a more accurate high-resolution image, theedge of an object in the image can be more accurately acquired, so thata clearer image can be obtained.

Alternatively, it is preferable that local dimming processing beperformed after super-resolution processing, edge enhancementprocessing, and frame interpolation processing are performed. When thesuper-resolution processing is performed, due to restoration of data,new data is added. Thus, the gray level of each pixel is differentbefore and after the super-resolution processing in some cases.Alternatively, before and after the super-resolution processing, thereis a region where the gray level of a pixel is changed in a screen. In asimilar manner, by the edge enhancement processing, an image isprocessed such that the edge of an object in the image is enhanced.Thus, there is a region where the gray level of a pixel is changed in ascreen. In a similar manner, by the frame interpolation processing, anew frame and a new image are generated. Thus, there is a region wherethe gray level of a pixel is changed in a screen. Thus, by performinglocal dimming after a new frame is generated by frame interpolationprocessing, image data is restored by super-resolution processing, andimage processing is performed by edge enhancement processing, the localdimming processing can be accurately performed. Therefore, contrast canbe improved and an accurate image can be displayed. Accordingly, inorder to obtain a high-quality image, it is preferable to perform thesuper-resolution processing, the edge enhancement processing, and theframe interpolation processing before the local dimming processing isperforated. Alternatively, in the local dimming processing, it ispreferable to perform the super-resolution processing, the edgeenhancement processing, and the frame interpolation processing beforeprocessing for determining the luminance of a backlight is performed.Alternatively, in the local dimming processing, it is preferable toperform the super-resolution processing, the edge enhancementprocessing, and the frame interpolation processing before processing fordetermining a video signal supplied to a pixel is performed. Note thatone example of this embodiment is not limited to this.

FIG. 8C illustrates a processing flow in the case where frameinterpolation processing is performed using an image signal obtainedfrom an image source, super-resolution processing is performed so thatresolution is increased, local dimming processing is performed, and thenoverdrive processing is performed. Therefore, the processing flow inFIG. 8C corresponds to a processing flow where local dimming processingis added to the processing flow in FIG. 8A. Alternatively, theprocessing flow in FIG. 8C corresponds to a processing flow whereoverdrive processing is added to the processing flow in FIG. 8B.Alternatively, the processing flow in FIG. 8C corresponds to aprocessing flow where overdrive processing and local dimming processingare added to the processing flow in FIG. 1A. Alternatively, theprocessing flow in FIG. 8C corresponds to a processing flow where localdimming processing is added to the processing flow in FIG. 7C.Alternatively, the processing flow in FIG. 8C corresponds to aprocessing flow where local dimming processing is added to theprocessing flow in FIG. 7D.

It is preferable that local dimming processing be performed aftersuper-resolution processing and frame interpolation processing areperformed in this manner. When the super-resolution processing isperformed, due to restoration of data, new data is added. Thus, the graylevel of each pixel is different before and after the super-resolutionprocessing in some cases. Alternatively, before and after thesuper-resolution processing, there is a region where the gray level of apixel is changed in a screen. In a similar manner, by the frameinterpolation processing, a new frame and a new image are generated.Thus, there is a region where the gray level of a pixel is changed in ascreen. Therefore, by performing local dimming after a new frame isgenerated by frame interpolation processing and image data is restoredby super-resolution processing, the local dimming processing can beaccurately performed. Thus, contrast can be improved and an accurateimage can be displayed. Accordingly, in order to obtain a high-qualityimage, it is preferable to perform the super-resolution processing andthe frame interpolation processing before the local dimming processingis performed. Alternatively, in the local dimming processing, it ispreferable to perform the super-resolution processing and the frameinterpolation processing before processing for determining the luminanceof a backlight is performed. Alternatively, in the local dimmingprocessing, it is preferable to perform the super-resolution processingand the frame interpolation processing before processing for determininga video signal supplied to a pixel is performed. Note that one exampleof this embodiment is not limited to this.

Alternatively, by performing overdrive processing after frameinterpolation processing, super-resolution processing, and local dimmingprocessing are performed, response speed can be made higher, the amountof overdrive can be controlled adequately, and display with fewerafterimages can be performed. Alternatively, the gray level of eachpixel is changed in accordance with a change in luminance of an image ora backlight by frame interpolation processing, super-resolutionprocessing, and local dimming processing; thus, overdrive processing canbe changed in accordance with the amount of a change in luminance.Therefore, by performing the overdrive processing after the frameinterpolation processing, the super-resolution processing, and the localdimming processing are performed, the amount of overdrive can becontrolled adequately, so that the gray level of each pixel can beoptimized. Thus, the response speed can be made higher and the overdrivecan be accurately performed. Further, by the super-resolutionprocessing, a high-resolution image can be displayed without generationof afterimages. Furthermore, by the local dimming processing, ahigh-contrast image can be displayed. Alternatively, by the frameinterpolation processing, afterimages can be reduced and moving imagescan be accurately displayed. Accordingly, in order to obtain ahigh-quality image, it is preferable to perform the frame interpolationprocessing, the super-resolution processing, and the local dimmingprocessing before the overdrive processing is performed. Note that oneexample of this embodiment is not limited to this.

In the case where both local dimming processing and overdrive processingare performed in this manner, it is preferable that overdrive processingbe performed after the local dimming processing is performed, asillustrated in FIG. 8D. Note that one example of this embodiment is notlimited to this. Note that before and after each stage in the processingflow, a variety of different processings can be performed. As examplesof a variety of different processings, there are super-resolutionprocessing, edge enhancement processing, frame interpolation processing,overdrive processing, local dimming processing. IP conversionprocessing, enlargement processing, and the like. Further, differentprocessing is possible.

Therefore, in the case where overdrive processing is performed in FIG.8B or in the case where local dimming processing is performed in FIG.8A, a processing flow as in FIG. 8E is preferably used. Note that oneexample of this embodiment is not limited to this.

Embodiment 4

Next, the case where part of a processing flow is deformed is described.Therefore, the content described in any of the other embodiments can beapplied to, combined with, or replaced with this embodiment.

FIGS. 10A and 10B each illustrate an example of the case where part ofFIG. 7E, FIG. 7D, FIG. 8B, FIG. 8C, FIG. 8E, or the like is deformed.First, super-resolution processing is performed. Concurrently,processing for controlling the luminance of a backlight in local dimmingprocessing is performed using image data on which super-resolutionprocessing is not performed. Then, by using data whose resolution ismade higher by super-resolution processing and data related to thedetermined luminance of each region of the backlight, which has lowresolution, processing for determining a video signal to be supplied toeach pixel in the local dimming processing is performed.

In the case of performing the super-resolution processing, an image isnot significantly changed in some cases. In addition, the pitch of thebacklight is much larger than the pixel pitch. Therefore, even whenprocessing for determining the luminance of a backlight in each regionin the local dimming processing is performed by using data beforesubjected to the super-resolution processing, there is no practicalproblem.

By performing such processing, the super-resolution processing and theprocessing for controlling the luminance of a backlight in local dimmingprocessing can be concurrently performed. Thus, the total processingtime can be shortened. Accordingly, even in the case where real-timedisplay is needed, for example, in the case of displaying a game,display can be performed without delay.

For example, by using a multi-core CPU including a plurality of CPUcores and distributing processings across the CPU cores,super-resolution processing and local dimming processing can beperformed concurrently. With the use of a multi-core CPU in this manner,high-speed operation is possible with fewer components. Note that such amulti-core CPU can include a semiconductor device (or a transistor)formed using an SOI. With the use of an SOL operation can be performedwith low power consumption and heat generation during the operation canbe suppressed.

Note that in FIG. 10A, edge enhancement processing, overdriveprocessing, frame interpolation processing, or the like can be added.For example, a flow chart in the case where edge enhancement processingis added is illustrated in FIG. 10B. FIG. 1013 illustrates a flow chartin the case where edge enhancement processing is performed aftersuper-resolution processing is performed. Note that one example of thisembodiment is not limited to this.

FIGS. 11A and 11B each illustrate another example of the case where partof FIG. 7D, FIG. 8B, FIG. 8C, FIG. 8E, or the like is deformed. First,frame interpolation processing is performed. Concurrently, processingfor controlling the luminance of a backlight in local dimming processingis performed using image data whose frame frequency has not been madehigher. Next, super-resolution processing is performed using image datawhose frame frequency has been made higher by the frame interpolationprocessing. Then, by using data whose resolution is made higher and datarelated to the determined luminance of each region of the backlight,which has low resolution, processing for determining a video signalsupplied to each pixel in the local dimming processing is performed.

Note that the super-resolution processing and the processing forcontrolling the luminance of a backlight in the local dimming processingcan be performed concurrently.

For example, by using a multi-core CPU including a plurality of CPUcores and distributing processings across the CPU cores, frameinterpolation processing, super-resolution processing, and local dimmingprocessing can be performed concurrently. With the use of a multi-coreCPU in this manner, high-speed operation is possible with fewercomponents. Note that such a multi-core CPU can include a semiconductordevice (or a transistor) formed using an SOT. With the use of an SOI,operation can be performed with low power consumption and heatgeneration during the operation can be suppressed.

In the case of performing the frame interpolation processing, an imageis not significantly changed in some cases. In addition, the pitch ofthe backlight is much larger than the pixel pitch. Therefore, even whenprocessing for determining the luminance of a backlight in each regionin the local dimming processing is performed by using data beforesubjected to the frame interpolation processing, there is no practicalproblem.

By performing such processing, the frame interpolation processing andthe processing for controlling the luminance of a backlight in localdimming processing can be concurrently performed. Thus, the totalprocessing time can be shortened. Accordingly, even in the case wherereal-time display is needed, for example, in the case of displaying agame, display can be performed without delay.

Note that in FIG. 11A, edge enhancement processing, overdriveprocessing, or the like can be added. For example, FIG. 11B illustratesan example of the case where edge enhancement processing is alsoperformed. Note that one example of this embodiment is not limited tothis.

Note that in FIG. 11A, the super-resolution processing can be performedusing a plurality of processing systems. FIGS. 12A and 12B illustrateexamples of such a case. FIG. 12A corresponds to a processing flow towhich the processing flow in FIG. 1B is applied. FIG. 12B corresponds toa processing flow to which the processing flow in FIG. 5B is applied.The content described in Embodiment 1 can be applied in this manner. Theother contents can be applied in a similar manner.

Embodiment 5

In this embodiment, examples of lighting devices are described. Thelighting device can be used as a backlight of a liquid crystal displaydevice, an interior lamp, or the like. Note that one example of thisembodiment is not limited to this.

FIGS. 13A and 13B illustrate a backlight or a lighting device in thecase where a point light source is used. As illustrated in FIG. 13A, adevice 1001 includes a plurality of point light sources 1002. Byarranging the point light sources 1002 in array, a uniform planar lightsource can be formed. The device 1001 can be used as a backlight of aliquid crystal display device or part of the backlight of the liquidcrystal display device.

In addition, partitions 1003 are arranged in a lateral direction.Further, partitions 1004 are arranged in a longitudinal direction. Byarranging the plurality of partitions 1003 and the plurality ofpartitions 1004, the planar light source can be divided into a pluralityof regions. In FIG. 10A, the planar light source is divided into threeregions in the longitudinal direction and is divided into nine regionsin the lateral direction. Therefore, light can be prevented from leakinginto a different region by the partitions. Further, by controlling theluminance of the point light source 1002 in each region, local dimming(local dimming of a backlight) can be realized. In particular, byarranging the partitions, light can be prevented from leaking into adifferent region, so that the luminance of each region can be accuratelycontrolled. Therefore, the transmittance of a liquid crystal element ineach region can be easily derived. Alternatively, contrast can beimproved because of little light leakage. Note that one example of thisembodiment is not limited to this.

Alternatively, some of the light sources can be set to be in anon-lighting state and the non-lighting state can be moved line by lineor block by block in a screen. That is, the point light sources in thescreen can be party turned off and the off-state regions can be scanned.For example, the point light sources can be scanned from the top to thebottom. By performing such backlight scanning, afterimages can bereduced and moving-image characteristics can be improved.

Note that as the partitions, only partitions which are arranged in alateral direction like the partitions 1003 can be arranged.Alternatively, as the partitions, only partitions which are arranged ina longitudinal direction like the partitions 1004 can be arranged.Alternatively, it is possible not to provide a partition itself.

Note that it is preferable that a surface of the partition 1003 or thepartition 1004 be a mirror surface or a white surface. Note that oneexample of this embodiment is not limited to this. In the case of themirror surface, light can be reflected, so that light can be efficientlyutilized. Therefore, power consumption can be reduced. In the case ofthe white surface, light can be diffused. Therefore, boundaries betweenregions are not easily seen, so that visibility can be improved.

Note that the transmittance of the partition 1003 or the partition 1004is preferably less than or equal to 50%, more preferably less than orequal to 30%. Alternatively, the transmittance of the partition 1003 orthe partition 1004 is preferably greater than or equal to 1%, morepreferably greater than or equal to 5%. Note that one example of thisembodiment is not limited to this. Because of low transmittance, lightleakage can be reduced and the luminance of each region can beaccurately controlled. However, in the case where light does not passcompletely, the boundaries between the regions are seen, so thatvisibility is decreased in some cases. Therefore, when a slight amountof light passes, the boundaries between the regions are not easily seen,so that visibility can be improved.

Note that the partition 1003 or the partition 1004 can be formed usingan organic matter such as acrylic, plastics, polycarbonate, or PET. Notethat one example of this embodiment is not limited to this.

Note that a spacer 1005 can be provided. Note that one example of thisembodiment is not limited to this. It is possible not to provide thespacer 1005. The spacer 1005 has a function of preventing a sheetprovided over the point light sources 1002, the partitions 1003, thepartitions 1004, and the like from bending.

Note that in the case of providing the spacer 1005, the number of thespacers 1005 is not so large but can be small. Therefore, in FIG. 13A,the planar light source is divided into three regions in thelongitudinal direction and is divided into nine regions in the lateraldirection, so that twenty seven regions are provided in total. It ispossible to provide regions where the spacers 1005 are provided andregions where the spacers 1005 are not provided. Alternatively, thenumber of the spacers 1005 can be smaller than the number of theregions. In the case where the spacers 1005 are not provided in all theregions in this manner, manufacture can be facilitated and/or cost canbe reduced.

Note that it is preferable that the spacer 1005 be a transparent spacer,a black spacer, or a white spacer. With the transparent spacer, theblack spacer, or the white spacer, generation of unevenness in luminanceor deviation of color depending on existence and nonexistence of thespacer 1005 can be suppressed. Note that one example of this embodimentis not limited to this.

Note that the spacer 1005 can be formed using an organic matter such asacrylic, plastics, polycarbonate, or PET. Note that one example of thisembodiment is not limited to this.

Note that for example, the point light source 1002 is formed usinglight-emitting diodes of three colors or lasers of three colors. Inaddition, the light-emitting diodes or the lasers have colors of red,blue, and green. Further, for example, by using the lasers of threecolors, a white color can be expressed. Therefore, colors are notlimited to red, blue, and green as long as a white color can beexpressed. For example, cyan, magenta, yellow, and the like (CMYK) canbe used for the point light source.

In the case where luminance can be controlled in each color in thismanner, local dimming can be performed more precisely. Thus, powerconsumption can be reduced or contrast can be improved, for example.

Note that the number of light-emitting diodes of each color ispreferably the same. Note that one example of this embodiment is notlimited to this. Only the number of light-emitting diodes of a certaincolor can be increased. For example, the number of green light-emittingdiodes can be twice the number of red or blue light-emitting diodes. Bychanging the number of light-emitting diodes in each color in thismanner, chromaticity can be easily adjusted. Further, a difference inthe life of light-emitting diodes between the respective colors can besuppressed.

Note that colors of the light-emitting diodes are not limited to threecolors. For example, by using a light-emitting diode having a colorwhich is similar to a certain color, chromaticity can be increased. Forexample, four colors can be used by addition of a color which is similarto green to red, blue, and green.

Note that a white light-emitting diode can be used in addition to a redlight-emitting diode, a blue light-emitting diode, and a greenlight-emitting diode. By using the white light-emitting diode, the livesof the light-emitting diodes can be prolonged. Alternatively, by usingthe white light-emitting diode, the change in color due to temperaturecan be suppressed.

Note that it is possible to use only a white light-emitting diode andnot to use a light-emitting diode other than the white light-emittingdiode, such as a red light-emitting diode, a blue light-emitting diode,or a green light-emitting diode. By using only the white light-emittingdiode, colors can be prevented from not being mixed with each other.Alternatively, by using only the white light-emitting diode, deviationof color due to deterioration can be suppressed.

Note that a pitch 1007 of the point light source 1002 in the lateraldirection is preferably shorter than a pitch 1006 of the point lightsource 1002 in the longitudinal direction. Note that one example of thisembodiment is not limited to this.

Note that as for the number of regions, the number of regions in thelateral direction is preferably larger than the number of regions in thelongitudinal direction. For example, the number of regions in thelongitudinal direction is three and the number of regions in the lateraldirection is nine in FIG. 13A.

Note that the number of regions in one screen is preferably smaller thanthe number of light-emitting diodes of a certain color. That is, as fora certain color in one region, a plurality of point light sources arepreferably provided. As for the point light sources provided in oneregion, the luminance of the plurality of point light sources of acertain color is preferably controlled so as to be the same luminance atthe same time. That is, luminance is preferably controlled in each colorin one region. For example, in the case where three red light-emittingdiodes are provided in one region, it is preferable that the luminanceof the three light-emitting diodes be raised when the luminance israised and the luminance of the three light-emitting diodes be loweredwhen the luminance is lowered. However, since characteristics oflight-emitting diodes or the like vary, it is difficult to make thelight-emitting diode have the same luminance. Therefore, it ispreferable that the light-emitting diodes emit light at the sameluminance in consideration of variations in characteristics. Forexample, it is preferable that the light-emitting diodes emit light atthe same luminance in consideration of a variation of approximately 30%.By providing a plurality of point light sources in one region in thismanner, unevenness in luminance can be suppressed. Alternatively,deterioration of the point light sources can be suppressed. Note thatone example of this embodiment is not limited to this.

FIG. 13B illustrates an example of part of a cross section in FIG. 13A.A diffusing plate 1011 is provided over the device 1001. Unevenness inluminance is suppressed by the diffusing plate 1011. The diffusing plate1011 is supported by the spacers 1005 so as not to bend even in thecenter of the screen.

A display panel 1012 is provided over the diffusing plate 1011. Thedisplay panel includes, for example, a pixel, a driver circuit, a liquidcrystal element, a glass substrate, a thin film transistor, apolarization plate, a retardation plate, a color filter, and/or a prismsheet. By operating the display panel 1012 in cooperation with thebacklight, appropriate display can be performed.

Note that the diffusing plate 1011 has a function of diffusing lightwhile transmitting light. Thus, it is preferable that the diffusingplate 1011 have a function of diffusing light and have hightransmittance. Therefore, the transmittance of the diffusing plate 1011is preferably higher than the transmittance of the partition 1003. Whenthe transmittance of the diffusing plate 1011 is high, light reflectedon the partition 1003 can be transmitted through the diffusing plate1011. Thus, light can be prevented from leaking into a different regionand can be easily emitted to the screen. Therefore, luminance in eachregion can be precisely controlled and local dimming can be accuratelyperformed. Note that one example of this embodiment is not limited tothis.

Note that height 1014 of the partition 1003 is preferably higher thanheight 1013 of the point light source 1002. In order to prevent lightemitted from the point light source 1002 from leaking into a differentregion, the height 1014 of the partition 1003 is preferably higher thanthe height 1013 of the point light source 1002. Note that one example ofthis embodiment is not limited to this.

Note that a distance 1015 between the partition 1003 and the diffusingplate 1011 is preferably shorter than the height 1014 of the partition1003. In the case where the distance 1015 is long, a large amount oflight leaks. Therefore, the distance 1015 is preferably shorter than theheight 1014 of the partition 1003. Note that one example of thisembodiment is not limited to this.

Note that the distance 1015 between the partition 1003 and the diffusingplate 1011 is preferably longer than the height 1013 of the point lightsource 1002. In the case where the distance 1015 is too short,boundaries between regions may be seen on the screen because theboundaries are sharp. Therefore, in order that the boundaries betweenthe regions are not seen on the screen, length for leakage of some lightis needed. Thus, by making the height of the partition 1003 higher thanthe height 1013 of the point light source 1002, an appropriate amount oflight can leak. Note that one example of this embodiment is not limitedto this.

Note that it is preferable that the height 1014 of the partition 1003 besubstantially the same as the height of the point light source 1002.Description “substantially the same” refers to the case where twoobjects have the same values in consideration of an error inmanufacturing, variation, or a slight difference. For example, avariation of approximately 10% can be included. By making the height ofthe partition be substantially the same as the height of the point lightsource 1002, the amount of light leakage can be uniform, so thatunevenness in luminance can be suppressed. Note that one example of thisembodiment is not limited to this.

Note that although the point light source is provided in each region inFIGS. 13A and 13B, one example of this embodiment is not limited tothis. A small planar light source can be provided in each region. FIGS.14A to 14D illustrate an example of the case where a planar light sourceis provided in each region. The planar light source can be formed in amanner similar to that in the case of point light source. Therefore, thecontent (may be part of the content) or the diagram (may be part of thediagram) described in FIGS. 13A and 13B can be applied to FIGS. 14A to14D.

In FIG. 14A, a planar light source 1102 is provided in each region. Theplanar light source 1102 can be realized with a variety of structures.

Note that although FIG. 11A illustrates the case where the partition1003 and the partition 1004 are not provided, one example of thisembodiment is not limited to this. Only partitions which are arranged ina lateral direction like the partitions 1003 can be arranged.Alternatively, only partitions which are arranged in a longitudinaldirection like the partitions 1004 can be arranged. Alternatively, it ispossible to provide both of the partitions.

Note that the spacer 1005 can be provided. Note that one example of thisembodiment is not limited to this. It is possible not to provide thespacer 1005. The spacer 1005 has a function of preventing a sheetprovided over the planar light sources 1102 and the like from bending.Note that in the case of the planar light source, the area of a void ina region is small, so that it is possible not to provide the spacer1005.

Note that the pitch of the planar light source 1102 in the lateraldirection is preferably shorter than the pitch of the planar lightsource 1102 in the longitudinal direction. Note that one example of thisembodiment is not limited to this.

Note that the height of the partition is preferably higher than theheight of the planar light source 1102. In order to prevent lightemitted from the planar light source 1102 from leaking into a differentregion, the height of the partition is preferably higher than the heightof the planar light source 1102. Note that one example of thisembodiment is not limited to this.

Further, in the case where a diffusing plate is provided over the planarlight source 1102, a distance between the partition and the diffusingplate is preferably longer than the height of the planar light source1102. In the case where the distance is too short, boundaries betweenregions may be seen on a screen because the boundaries are sharp.Therefore, in order that the boundaries between the regions are not seenon the screen, length for leakage of some light is needed. Thus, bymaking the height of the partition higher than the height of the planarlight source 1102, an appropriate amount of light can leak. Note thatone example of this embodiment is not limited to this.

Next, as an example of the planar light source 1102, FIG. 14Billustrates a cross section in the case where a light guide plate and aline light source (or a group of point light sources) are provided and asmall planar light source is formed. FIG. 14B illustrates a crosssection of three planar light sources. Light enters a light guide plate1104 from a line light source 1103. Light is fully reflected in thelight guide plate 1104 repeatedly and is transmitted. In addition, abottom surface 1105 of the light guide plate 1104 is processed.Therefore, light is emitted from a surface of the light guide plate1104, so that a planar light source is realized.

For example, the bottom surface 1105 is processed as follows: unevennessis formed like a prism, or ink is printed. By controlling density,shape, or the like thereof, a uniform planar light source can berealized.

Note that in the case where a planar light source as in FIG. 14A isused, the diffusing plate 1011 can be provided over the planar lightsource. Thus, unevenness in luminance can be suppressed. Note thatunlike the case of using a point light source, in the case of using theplanar light source 1102, luminance has already been uniformed to someextent. Thus, it is possible not to provide the diffusing plate 1011.

As another example of the planar light source 1102, a plane fluorescenttube (plane cathode tube) can be used.

Alternatively, as illustrated in FIG. 14C, a fluorescent tube (cathodetube) 1106 is bent and provided in a region so as to be used like aplane fluorescent tube (plane cathode tube). Thus, a planar light sourcecan be realized. In that ease, as illustrated in a cross-sectional viewin FIG. 14D, by providing a diffusing plate 1107 around the fluorescenttube (cathode tube) 1106, in particular, above the fluorescent tube(cathode tube) 1106, it is possible to make the planar light sourcecloser to a uniform planar light source. Note that one example of thisembodiment is not limited to this.

Embodiment 6

Next, another structure example and a driving method of a display deviceare described. In this embodiment, the case of using a display deviceincluding a display element whose luminance response with respect tosignal writing is slow (response time is long) is described. In thisembodiment, a liquid crystal element is described as an example of thedisplay element with long response time. In this embodiment, a liquidcrystal element is illustrated as an example of the display element withlong response time. However, a display element in this embodiment is notlimited to this, and a variety of display elements whose luminanceresponse with respect to signal writing is slow can be used.

In a general liquid crystal display device, luminance response withrespect to signal writing is slow, and it sometimes takes more than oneframe period to complete the response even when signal voltage iscontinuously applied to a liquid crystal element. Moving images cannotbe displayed precisely by such a display element. Further, in the caseof active matrix driving, time for signal writing to one liquid crystalelement is only a period (one scan line selection period) obtained bydividing a signal writing cycle (one frame period or one subframeperiod) by the number of scan lines, and the liquid crystal elementcannot respond in such a short time in many cases. Therefore, most ofthe response of the liquid crystal element is performed in a periodduring which signal writing is not performed. Here, the dielectricconstant of the liquid crystal element is changed in accordance with thetransmittance of the liquid crystal element, and the response of theliquid crystal element in a period during which signal writing is notperformed means that the dielectric constant of the liquid crystalelement is changed in a state where electric charge is not exchangedwith the outside of the liquid crystal element (in a constant chargestate). In other words, in a formula wherecharge=(capacitance)·(voltage), the capacitance is changed in a statewhere the charge is constant. Accordingly, voltage applied to the liquidcrystal element is changed from voltage in signal writing, in accordancewith the response of the liquid crystal element. Therefore, in the casewhere the liquid crystal element whose luminance response with respectto signal writing is slow is driven by active matrix driving, voltageapplied to the liquid crystal element cannot theoretically reach thevoltage in signal writing.

In the display device in this embodiment, a signal level in signalwriting is corrected in advance (a correction signal is used) so that adisplay element can reach desired luminance within a signal writingcycle. Thus, the above problem can be solved. Further, since theresponse time of the liquid crystal element becomes shorter as thesignal level becomes higher, the response time of the liquid crystalelement can also be shorter by writing a correction signal. A drivingmethod by which such a correction signal is added is referred to asoverdrive. By overdrive in this embodiment, even when a signal writingcycle is shorter than a cycle for an image signal input to the displaydevice (an input image signal cycle T_(in)), the signal level iscorrected in accordance with the signal writing cycle, so that thedisplay element can reach desired luminance within the signal writingcycle. The case where the signal writing cycle is shorter than the inputimage signal cycle T_(in) is, for example, the case where one originalimage is divided into a plurality of subimages and the plurality ofsubimages are sequentially displayed in one frame period.

Next, an example of correcting a signal level in signal writing in adisplay device driven by active matrix driving is described withreference to FIGS. 15A and 15B. FIG. 15A is a graph schematicallyillustrating a time change in luminance of signal level in signalwriting in one display element, with the time as the horizontal axis andthe signal level in signal writing as the vertical axis. FIG. 15B is agraph schematically illustrating a time change in display level, withthe time as the horizontal axis and the display level as the verticalaxis. Note that when the display element is a liquid crystal element,the signal level in signal writing can be voltage, and the display levelcan be the transmittance of the liquid crystal element. In the followingdescription, the vertical axis in FIG. 15A is regarded as the voltage,and the vertical axis in FIG. 15B is regarded as the transmittance. Notethat in the overdrive in this embodiment, the signal level may be otherthan the voltage (may be a duty ratio or current, for example). Notethat in the overdrive in this embodiment, the display level may be otherthan the transmittance (may be luminance or current, for example).Liquid crystal elements are classified into two modes: a normally blackmode in which black is displayed when voltage is 0 (e.g., a VA mode andan IPS mode), and a normally white mode in which white is displayed whenvoltage is 0 (e.g., a TN mode and an OCB mode). The graph illustrated inFIG. 15B corresponds to both of the modes. The transmittance increasesin the upper part of the graph in the normally black mode, and thetransmittance increases in the lower part of the graph in the normallywhite mode. That is, a liquid crystal mode in this embodiment may beeither a normally black mode or a normally white mode. Note that timingof signal writing is represented on the time axis by dotted lines, and aperiod after signal writing is performed until the next signal writingis performed is referred to as a retention period F_(i). In thisembodiment, i is an integer and an index for representing each retentionperiod. In FIGS. 15A and 15B, i is 0 to 2; however, i can be an integerother than 0 to 2 (only the case where i is 0 to 2 is illustrated). Notethat in the retention period F_(i), transmittance for realizingluminance corresponding to an image signal is denoted by T_(i), andvoltage for providing the transmittance T_(i) in a constant state isdenoted by V_(i). In FIG. 15A, a dashed line 5101 represents a timechange in voltage applied to the liquid crystal element in the casewhere overdrive is not performed, and a solid line 5102 represents atime change in voltage applied to the liquid crystal element in the casewhere the overdrive in this embodiment is performed. In a similarmanner, in FIG. 15B, a dashed line 5103 represents a time change intransmittance of the liquid crystal element in the case where overdriveis not performed, and a solid line 5104 represents a time change intransmittance of the liquid crystal element in the case where theoverdrive in this embodiment is performed. Note that a differencebetween the desired transmittance T_(i) and the actual transmittance atthe end of the retention period F_(i) is referred to as an error α_(i).

It is assumed that, in the graph illustrated in FIG. 15A, both thedashed line 5101 and the solid line 5102 represent the case wheredesired voltage V₀ is applied in a retention period F₀; and in the graphillustrated in FIG. 15B, both the dashed line 5103 and the solid line5104 represent the case where desired transmittance T₀ is obtained. Inthe case where overdriving is not performed, desired voltage V₁ isapplied at the beginning of a retention period F₁ as shown by the dashedline 5101. As has been described above, a period for signal writing ismuch shorter than a retention period, and the liquid crystal element isin a constant charge state in most of the retention period. Accordingly,voltage applied to the liquid crystal element in the retention period F₁is changed along with a change in transmittance and is greatly differentfrom the desired voltage V₁ at the end of the retention period F₁. Inthis case, the dashed line 5103 in the graph of FIG. 15B is greatlydifferent from desired transmittance T₁. Accordingly, accurate displayof an image signal cannot be performed, so that image quality isdecreased. On the other hand, in the case where the overdrive in thisembodiment is performed, voltage V₁′ which is higher than the desiredvoltage V₁ is applied to the liquid crystal element at the beginning ofthe retention period F₁ as shown by the solid line 5102. That is, thevoltage V₁′ which is corrected from the desired voltage V₁ is applied tothe liquid crystal element at the beginning of the retention period F₁so that the voltage applied to the liquid crystal element at the end ofthe retention period F₁ is close to the desired voltage V₁ inanticipation of a gradual change in voltage applied to the liquidcrystal element in the retention period F₁. Thus, the desired voltage V₁can be accurately applied to the liquid crystal element. In this case,as shown by the solid line 5104 in the graph of FIG. 15B, the desiredtransmittance T₁ can be obtained at the end of the retention period F₁.In other words, the response of the liquid crystal element within thesignal writing cycle can be realized, despite the fact that the liquidcrystal element is in a constant charge state in most of the retentionperiod. Then, in a retention period F₂, the case where desired voltageV₂ is lower than V₁ is described. Also in that case, as in the retentionperiod F₁, voltage V₂′ which is corrected from the desired voltage V₂may be applied to the liquid crystal element at the beginning of theretention period F₂ so that the voltage applied to the liquid crystalelement at the end of the retention period F₂ is close to the desiredvoltage V₂ in anticipation of a gradual change in voltage applied to theliquid crystal element in the retention period F₂. Thus, as shown by thesolid line 5104 in the graph of FIG. 15B, desired transmittance T₂ canbe obtained at the end of the retention period F₂. Note that in the casewhere V_(i) is higher than V_(i−1) as in the retention period F₁, thecorrected voltage V_(i)′ is preferably corrected so as to be higher thandesired voltage V_(i). Further, when V_(i) is lower than V_(i−1) as inthe retention period F₂, the corrected voltage V_(i)′ is preferablycorrected so as to be lower than the desired voltage V_(i). Note that aspecific correction value can be derived by measuring responsecharacteristics of the liquid crystal element in advance. As a method ofrealizing overdrive in a device, a method by which a correction formulais formulated and included in a logic circuit, a method by which acorrection value is stored in a memory as a look-up table and is read asnecessary, or the like can be used.

Note that there are several limitations on realization of the overdrivein this embodiment in a device. For example, voltage correction has tobe performed in the range of the rated voltage of a source driver. Thatis, in the case where desired voltage is originally high and idealcorrection voltage exceeds the rated voltage of the source driver, notall the correction can be performed. Problems in such a case aredescribed with reference to FIGS. 15C and 15D. As in FIG. 15A, FIG. 15Cis a graph in which a time change in voltage in one liquid crystalelement is schematically illustrated as a solid line 5105 with the timeas the horizontal axis and the voltage as the vertical axis. As in FIG.15B, FIG. 15D is a graph in which a time change in transmittance of oneliquid crystal element is schematically illustrated as a solid line 5106with the time as the horizontal axis and the transmittance as thevertical axis. Note that since other references are similar to those inFIGS. 15A and 15B, description thereof is omitted. FIGS. 15C and 15Dillustrate a state where sufficient correction cannot be performedbecause the correction voltage V₁′ for realizing the desiredtransmittance T₁ in the retention period F₁ exceeds the rated voltage ofthe source driver; thus V₁′=V₁ has to be given. In this case, thetransmittance at the end of the retention period F₁ is deviated from thedesired transmittance T₀ by the error α₁. Note that the error α₁ isincreased only when the desired voltage is originally high; therefore, adecrease in image quality due to occurrence of the error α₁ is in theallowable range in many cases. However, as the error α₁ is increased, anerror in algorithm for voltage correction is also increased. In otherwords, in the algorithm for voltage correction, when it is assumed thatthe desired transmittance is obtained at the end of the retentionperiod, even though the error α₁ is increased, voltage correction isperformed on the basis that the error α₁ is small. Accordingly, theerror is included in correction in the following retention period F₂;thus, an error α₂ is also increased. Further, in the case where theerror α₂ is increased, the following error α₃ is further increased, forexample, and the error is increased in a chain reaction manner, whichresults in a significant decrease in image quality. In the overdrive inthis embodiment, in order to prevent increase of errors in such a chainreaction manner, when the correction voltage V_(i)′ exceeds the ratedvoltage of the source driver in the retention period F_(i), an errorα_(i) at the end of the retention period F_(i) is estimated, and thecorrection voltage in a retention period F_(i+1) can be adjusted inconsideration of the amount of the error α_(i). Thus, even when theerror α_(i) is increased, the effect of the error α_(i) on the errorα_(i+1) can be minimized, so that increase of errors in a chain reactionmanner can be prevented. An example where the error α₂ is minimized inthe overdrive in this embodiment is described with reference to FIGS.15E and 15F. In a graph of FIG. 15E, a solid line 5107 represents a timechange in voltage in the case where the correction voltage V₂′ in thegraph of FIG. 15C is further adjusted to be correction voltage V₂′. Agraph of FIG. 15F illustrates a time change in transmittance in the casewhere voltage is corrected in accordance with the graph of FIG. 15E. Thesolid line 5106 in the graph of FIG. 15D indicates that excessivecorrection is caused by the correction voltage V₂′. On the other hand,the solid line 5108 in the graph of FIG. 15F indicates that excessivecorrection is suppressed by the correction voltage V₂″ which is adjustedin consideration of the error α₁ and the error α₂ is minimized. Notethat a specific correction value can be derived from measuring responsecharacteristics of the liquid crystal element in advance. As a method ofrealizing overdrive in a device, a method by which a correction formulais formulated and included in a logic circuit, a method by which acorrection value is stored in a memory as a look-up table and read asnecessary, or the like can be used. Further, such a method can be addedseparately from a portion for calculating correction voltage V_(i)′ orcan be included in the portion for calculating correction voltageV_(i)′. Note that the amount of correction of correction voltage V_(i)″which is adjusted in consideration of an error α_(i−1) (a differencewith the desired voltage V_(i)) is preferably smaller than that ofV_(i)′. That is, |V_(i)′″−V_(i)|<|V_(i)′−V_(i)| is preferable.

Note that the error α_(i) which is caused because ideal correctionvoltage exceeds the rated voltage of the source driver is increased as asignal writing cycle becomes shorter. This is because the response timeof the liquid crystal element needs to be shorter as the signal writingcycle becomes shorter, so that higher correction voltage is necessary.Further, as a result of an increase in correction voltage needed, thecorrection voltage exceeds the rated voltage of the source driver morefrequently, so that the large error α_(i) occurs more frequently.Therefore, it can be said that the overdrive in this embodiment becomesmore effective as the signal writing cycle becomes shorter.Specifically, the overdrive in this embodiment is significantlyeffective in the case of performing the following driving methods: adriving method by which one original image is divided into a pluralityof subimages and the plurality of subimages are sequentially displayedin one frame period, a driving method by which motion of an image isdetected from a plurality of images and an intermediate image of theplurality of images is generated and inserted between the plurality ofimages (so-called motion compensation frame rate doubling), and adriving method in which such driving methods are combined, for example.

Note that the rated voltage of the source driver has the lower limit inaddition to the upper limit described above. An example of the lowerlimit is the case where voltage which is lower than the voltage 0 cannotbe applied. In this case, since ideal correction voltage cannot beapplied as in the case of the upper limit described above, the errorα_(i) is increased. However, also in that case, the error α_(i) at theend of the retention period F_(i) is estimated, and the correctionvoltage in the retention period F_(i+1) can be adjusted in considerationof the amount of the error α_(i) a manner similar to the above method.Note that in the case where voltage which is lower than the voltage 0(negative voltage) can be applied as the rated voltage of the sourcedriver, the negative voltage may be applied to the liquid crystalelement as correction voltage. Thus, the voltage applied to the liquidcrystal element at the end of retention period F_(i) can be adjusted soas to be close to the desired voltage V_(i) in anticipation of a changein potential due to a constant charge state.

Note that in order to suppress deterioration of the liquid crystalelement, so-called inversion driving by which the polarity of voltageapplied to the liquid crystal element is periodically inverted can beperformed in combination with the overdrive. That is, the overdrive inthis embodiment includes the case where the overdrive is performed atthe same time as the inversion driving. For example, in the case wherethe length of the signal writing cycle is half of that of the inputimage signal cycle T_(in), when the length of a cycle for invertingpolarity is the same or substantially the same as that of the inputimage signal cycle T_(in), two sets of writing of a positive signal andtwo sets of writing of a negative signal are alternately performed. Thelength of the cycle for inverting polarity is made larger than that ofthe signal writing cycle in this manner, so that the frequency of chargeand discharge of a pixel can be reduced. Thus, power consumption can bereduced. Note that when the cycle for inverting polarity is made toolong, a defect in which luminance difference due to the difference ofpolarity is recognized as a flicker occurs in some cases; therefore, itis preferable that the length of the cycle for inverting polarity besubstantially the same as or smaller than that of the input image signalcycle T_(in).

Embodiment 7

Next, another structure example and a driving method of a display deviceare described. In this embodiment, a method is described by which animage for interpolating motion of an image input from the outside of adisplay device (an input image) is generated inside the display devicein response to a plurality of input images and the generated image (thegeneration image) and the input image are sequentially displayed. Notethat when an image for interpolating motion of an input image is ageneration image, motion of moving images can be made smooth, and adecrease in quality of moving images because of afterimages or the likedue to hold driving can be suppressed. Here, moving image interpolationis described below. Ideally, display of moving images is realized bycontrolling the luminance of each pixel in real time; however,individual control of pixels in real time has problems such as theenormous number of control circuits, space for wirings, and the enormousamount of input image data. Thus, it is difficult to realize theindividual control of pixels. Therefore, for display of moving images bya display device, a plurality of still images are sequentially displayedin a certain cycle so that display appears to be moving images. Thecycle (in this embodiment, referred to as an input image signal cycleand denoted by T_(in)) is standardized, and for example, 1/60 second inNTSC and 1/50 second in PAL. Such a cycle does not cause a problem ofmoving image display in a CRT, which is an impulsive display device.However, in a hold-type display device, when moving images conforming tothese standards are displayed without change, a defect in which displayis blurred because of afterimages or the like due to hold driving (holdblur) occurs. Since hold blur is recognized by discrepancy betweenunconscious motion interpolation due to human eyes tracking andhold-type display, the hold blur can be reduced by making the inputimage signal cycle shorter than that in conventional standards (bymaking the control closer to individual control of pixels in real time).However, it is difficult to reduce the length of the input image signalcycle because the standard needs to be changed and the amount of data isincreased. However, an image for interpolating motion of an input imageis generated inside the display device in response to a standardizedinput image signal, and display is performed while the generation imageinterpolates the input image, so that hold blur can be reduced without achange in the standard or an increase in the amount of data. Operationsuch that an image signal is generated inside the display device inresponse to an input image signal to interpolate motion of the inputimage is referred to as moving image interpolation.

By a method for interpolating moving images in this embodiment, motionblur can be reduced. The method for interpolating moving images in thisembodiment can include an image generation method and an image displaymethod. Further, by using a different image generation method and/or adifferent image display method for motion with a specific pattern,motion blur can be effectively reduced. FIGS. 16A and 16B are schematicdiagrams each illustrating an example of a method for interpolatingmoving images in this embodiment. FIGS. 16A and 16B each illustratetiming of treating each image by using the position of the horizontaldirection, with the time as the horizontal axis. A portion representedas “input” indicates timing at which an input image signal is input.Here, images 5121 and 5122 are focused as two images that are temporallyadjacent. An input image is input at an interval of the cycle T_(in).Note that the length of one cycle T_(in) is referred to as one frame orone frame period in some cases. A portion represented as “generation”indicates timing at which a new image is generated from an input imagesignal. Here, an image 5123 which is a generation image generated inresponse to the images 5121 and 5122 is focused. A portion representedas “display” indicates timing at which an image is displayed in thedisplay device. Note that images other than the focused images are onlyrepresented by dashed lines, and by treating such images in a marinersimilar to that of the focused images, the example of the method forinterpolating moving images in this embodiment can be realized.

In the example of the method for interpolating moving images in thisembodiment, as illustrated in FIG. 16A, a generation image which isgenerated in response to two input images that are temporally adjacentis displayed in a period after one image is displayed until the otherimage is displayed, so that moving image interpolation can be performed.In this case, a display cycle of a display image is preferably half ofan input cycle of the input image. Note that the display cycle is notlimited to this and can be a variety of display cycles. For example, inthe case where the length of the display cycle is shorter than half ofthat of the input cycle, moving images can be displayed more smoothly.Alternatively, in the case where the length of the display cycle islonger than half of that of the input cycle, power consumption can bereduced. Note that here, an image is generated in response to two inputimages which are temporally adjacent; however, the number of inputimages serving as a basis is not limited to two and can be othernumbers. For example, when an image is generated in response to three(may be more than three) input images which are temporally adjacent, ageneration image with higher accuracy can be obtained as compared to thecase where an image is generated in response to two input images. Notethat the display timing of the image 5121 is the same as the inputtiming of the image 5122, that is, the display timing is one frame laterthan the input timing. However, display timing in the method forinterpolating moving images in this embodiment is not limited to thisand can be a variety of display timings. For example, the display timingcan be delayed with respect to the input timing by more than one frame.Thus, the display timing of the image 5123 which is the generation imagecan be delayed, which allows enough time to generate the image 5123 andleads to reduction in power consumption and manufacturing cost. Notethat when the display timing is delayed with respect to the input timingfor a long time, a period for holding an input image becomes longer, andthe memory capacity which is necessary for holding the input image isincreased. Therefore, the display timing is preferably delayed withrespect to the input timing by approximately one to two frames.

Here, an example of a specific generation method of the image 5123 whichis generated in response to the images 5121 and 5122 is described. It isnecessary to detect motion of an input image in order to interpolatemoving images. In this embodiment, a method called a block matchingmethod can be used in order to detect motion of an input image. Notethat this embodiment is not limited to this, and a variety of methods(e.g., a method for obtaining a difference of image data or a method ofusing Fourier transformation) can be used. In the block matching method,first, image data for one input image (here, image data of the image5121) is stored in a data storage means (e.g., a memory circuit such asa semiconductor memory or a RAM). Then, an image in the next frame(here, the image 5122) is divided into a plurality of regions. Note thatthe divided regions can have the same rectangular shapes as illustratedin FIG. 16A; however, the divided regions are not limited to them andcan have a variety of shapes (e.g., the shape or size varies dependingon images). After that, in each divided region, data is compared to theimage data in the previous frame (here, the image data of the image5121), which is stored in the data storage means, so that a region wherethe image data is similar to each other is searched. The example of FIG.16A illustrates that the image 5121 is searched for a region where datais similar to that of a region 5124 in the image 5122, and a region 5126is found. Note that a search range is preferably limited when the image5121 is searched. In the example of FIG. 16A, a region 5125 which isapproximately four times larger than the region 5124 is set as thesearch range. By making the search range larger than this, detectionaccuracy can be increased even in a moving image with high-speed motion.Note that search in an excessively wide range needs an enormous amountof time, which makes it difficult to realize detection of motion. Thus,the region 5125 has preferably approximately two to six times largerthan the area of the region 5124. After that, a difference of theposition between the searched region 5126 and the region 5124 in theimage 5122 is obtained as a motion vector 5127. The motion vector 5127represents motion of image data in the region 5124 in one frame period.Then, in order to generate an image illustrating the intermediate stateof motion, an image generation vector 5128 obtained by changing the sizeof the motion vector without a change in the direction thereof isgenerated, and image data included in the region 5126 of the image 5121is moved in accordance with the image generation vector 5128, so thatimage data in a region 5129 of the image 5123 is generated. Byperforming a series of processings on the entire region of the image5122, the image 5123 is generated. Then, by sequentially displaying theinput image 5121, the image 5123, and the image 5122, moving images canbe interpolated. Note that the position of an object 5130 in the imageis different (i.e., the object is moved) between the images 5121 and5122. In the generated image 5123, the object is located at the midpointbetween the images 5121 and 5122. By displaying such images, motion ofmoving images can be made smooth, and blur of moving images due toafterimages or the like can be reduced.

Note that the size of the image generation vector 5128 can be determinedin accordance with the display timing of the image 5123. In the exampleof FIG. 16A, since the display timing of the image 5123 is the midpoint(½) between the display timings of the images 5121 and 5122, the size ofthe image generation vector 5128 is half of that of the motion vector5127. Alternatively, for example, when the display timing is ⅓ betweenthe display timings of the images 5121 and 5122, the size of the imagegeneration vector 5128 can be ⅓, and when the display timing is ⅔between the display timings of the images 5121 and 5122, the size can be⅔.

Note that in the case where a new image is generated by moving aplurality of regions having different motion vectors in this manner, aportion where one region has already been moved to a region that is adestination for another region or a portion to which any region is notmoved is generated in some cases (i.e., overlap or blank occurs in somecases). For such portions, data can be compensated. As a method forcompensating an overlap portion, a method by which overlap data isaveraged; a method by which data is arranged in order of priorityaccording to the direction of motion vectors or the like, andhigh-priority data is used as data in a generation image; or a method bywhich one of color and brightness is arranged in order of priority andthe other thereof is averaged can be used, for example. As a method forcompensating a blank portion, a method by which image data of theportion of the image 5121 or the image 5122 is used as data in ageneration image without modification, a method by which image data ofthe portion of the image 5121 or the image 5122 is averaged, or the likecan be used. Then, the generated image 5123 is displayed in accordancewith the size of the image generation vector 5128, so that motion ofmoving images can be made smooth, and the decrease in quality of movingimages because of afterimages or the like due to hold driving can besuppressed.

In another example of the method for interpolating moving images in thisembodiment, as illustrated in FIG. 16B, when a generation image which isgenerated in response to two input images which are temporally adjacentis displayed in a period after one image is displayed until the otherimage is displayed, each display image is divided into a plurality ofsubimages to be displayed. Thus, moving images can be interpolated. Thiscase can have advantages of displaying a dark image at regular intervals(advantages when a display method is made closer to impulsive display)in addition to advantages of a shorter image display cycle. That is,blur of moving images due to afterimages or the like can be furtherreduced as compared to the case where the length of the image displaycycle is just made to half of that of the image input cycle. In theexample of FIG. 16B, “input” and “generation” can be similar to theprocessings in the example of FIG. 16A; therefore, description thereofis omitted. For “display” in the example of FIG. 16B, one input imageand/or one generation image can be divided into a plurality of subimagesto be displayed. Specifically, as illustrated in FIG. 16B, the image5121 is divided into subimages 5121 a and 5121 b and the subimages 5121a and 5121 b are sequentially displayed so as to make human eyesperceive that the image 5121 is displayed; the image 5123 is dividedinto subimages 5123 a and 5123 b and the subimages 5123 a and 5123 b aresequentially displayed so as to make human eyes perceive that the image5123 is displayed; and the image 5122 is divided into subimages 5122 aand 5122 b and the subimages 5122 a and 5122 b are sequentiallydisplayed so as to make human eyes perceive that the image 5122 isdisplayed. That is, the display method can be made closer to impulsivedisplay while the image perceived by human eyes is similar to that inthe example of FIG. 16A, so that blur of moving images due toafterimages or the like can be further reduced. Note that the number ofdivision of subimages is two in FIG. 16B; however, the number ofdivision of subimages is not limited to this and can be other numbers.Note that subimages are displayed at regular intervals (½) in FIG. 16B;however, timing of displaying subimages is not limited to this and canbe a variety of timings. For example, when timing of displaying darksubimages 5121 b, 5122 b, and 5123 b is made earlier (specifically,timing at ¼ to ½), the display method can be made much closer toimpulsive display, so that blur of moving images due to afterimages orthe like can be further reduced. Alternatively, when the timing ofdisplaying dark subimages is delayed (specifically, timing at ½ to ¾),the length of a period for displaying a bright image can be increased,so that display efficiency can be increased and power consumption can bereduced.

Another example of the method for interpolating moving images in thisembodiment is an example in which the shape of an object which is movedin an image is detected and different processings are performeddepending on the shape of the moving object. FIG. 16C illustratesdisplay timing as in the example of FIG. 16B and the case where movingcharacters (also referred to as scrolling texts, subtitles, captions, orthe like) are displayed. Note that since terms “input” and “generation”may be similar to those in FIG. 16B, they are not illustrated in FIG.16C. The amount of blur of moving images by hold driving variesdepending on properties of a moving object in some cases. In particular,blur is recognized remarkably when characters are moved in many cases.This is because eyes track moving characters to read the characters, sothat hold blur easily occur. Further, since characters have clearoutlines in many cases, blur due to hold blur is further emphasized insome cases. That is, determining whether an object which is moved in animage is a character and performing special processing when the objectis the character are effective in reducing hold blur. Specifically, whenedge detection, pattern detection, and/or the like are/is performed onan object which is moved in an image and the object is determined to bea character, motion compensation is performed even on subimagesgenerated by division of one image so that an intermediate state ofmotion is displayed. Thus, motion can be made smooth. In the case wherethe object is determined not to be a character, when subimages aregenerated by division of one image as illustrated in FIG. 16B, thesubimages can be displayed without a change in the position of themoving object. The example of FIG. 16C illustrates the case where aregion 5131 determined to be characters is moved upward, and theposition of the region 5131 is different between the images 5121 a and5121 b. In a similar manner, the position of the region 5131 isdifferent between the images 5123 a and 5123 b, and between the images5122 a and 5122 b. Thus, motion of characters for which hold blur isparticularly easily recognized can be made smoother than that by normalmotion compensation frame rate doubling, so that blur of moving imagesdue to afterimages or the like can be further reduced.

Embodiment 8

In this embodiment, structures and operation of a pixel which can beused in a liquid crystal display device are described. Note that as theoperation mode of a liquid crystal element in this embodiment, a TN(twisted nematic) mode, an IPS (in-plane-switching) mode, an FFS (fringefield switching) mode, an MVA (multi-domain vertical alignment) mode, aPVA (patterned vertical alignment) mode, an ASM (axially symmetricaligned microcell) mode, an OCB (optically compensated birefringence)mode, an FLC (ferroelectric liquid crystal) mode, an AFLC(anti-ferroelectric liquid crystal) mode, or the like can be used.

FIG. 17A illustrates an example of a pixel structure which can be usedin the liquid crystal display device. A pixel 5080 includes a transistor5081, a liquid crystal element 5082, and a capacitor 5083. A gate of thetransistor 5081 is electrically connected to a wiring 5085. A firstterminal of the transistor 5081 is electrically connected to a wiring5084. A second terminal of the transistor 5081 is electrically connectedto a first terminal of the liquid crystal element 5082. A secondterminal of the liquid crystal element 5082 is electrically connected toa wiring 5087. A first terminal of the capacitor 5083 is electricallyconnected to the first terminal of the liquid crystal element 5082. Asecond terminal of the capacitor 5083 is electrically connected to awiring 5086. Note that a first terminal of a transistor is one of asource and a drain, and a second terminal of the transistor is the otherof the source and the drain. That is, when the first terminal of thetransistor is the source, the second terminal of the transistor is thedrain. In a similar manner, when the first terminal of the transistor isthe drain, the second terminal of the transistor is the source.

The wiring 5084 can serve as a signal line. The signal line is a wiringfor transmitting signal voltage, which is input from the outside of thepixel, to the pixel 5080. The wiring 5085 can serve as a scan line. Thescan line is a wiring for controlling on/off of the transistor 5081. Thewiring 5086 can serve as a capacitor line. The capacitor line is awiring for applying predetermined voltage to the second terminal of thecapacitor 5083. The transistor 5081 can serve as a switch. The capacitor5083 can serve as a storage capacitor. The storage capacitor is acapacitor with which the signal voltage is continuously applied to theliquid crystal element 5082 even when the switch is off. The wiring 5087can serve as a counter electrode. The counter electrode is a wiring forapplying predetermined voltage to the second terminal of the liquidcrystal element 5082. Note that the function of each wiring is notlimited to this, and each wiring can have a variety of functions. Forexample, by changing voltage applied to the capacitor line, voltageapplied to the liquid crystal element can be adjusted. Note that it isacceptable as long as the transistor 5081 serves as a switch, and thetransistor 5081 may be either a p-channel transistor or an n-channeltransistor.

FIG. 17B illustrates an example of a pixel structure which can be usedin the liquid crystal display device. The example of the pixel structureillustrated in FIG. 17B is the same as that in FIG. 17A except that thewiring 5087 is eliminated and the second terminal of the liquid crystalelement 5082 and the second terminal of the capacitor 5083 areelectrically connected to each other. The example of the pixel structureillustrated in FIG. 17B can be particularly used in the case of using ahorizontal electric field mode (including an IPS mode and an FFS mode)liquid crystal element. This is because in the horizontal electric fieldmode liquid crystal element, the second terminal of the liquid crystalelement 5082 and the second terminal of the capacitor 5083 can be formedover the same substrate, so that it is easy to electrically connect thesecond terminal of the liquid crystal element 5082 and the secondterminal of the capacitor 5083 to each other. With the pixel structureas illustrated in FIG. 17B, the wiring 5087 can be eliminated, so that amanufacturing process can be simplified and manufacturing cost can bereduced.

A plurality of pixel structures illustrated in FIG. 17A or FIG. 17B canbe arranged in matrix. Thus, a display portion of a liquid crystaldisplay device is formed, and a variety of images can be displayed. FIG.17C illustrates a circuit structure in the case where a plurality ofpixel structures illustrated in FIG. 17A are arranged in matrix. FIG.17C is a circuit diagram illustrating four pixels among a plurality ofpixels included in the display portion. A pixel arranged in an i-thcolumn and a j-th row (each of i and j is a natural number) isrepresented as a pixel 5080 _(—) i, j, and a wiring 5084 _(—) i, awiring 5085 _(—) j, and a wiring 5086 _(—) j are electrically connectedto the pixel 5080 _(—) i, j. In a similar manner, a wiring 5084 _(—)i+1, the wiring 5085 _(—) j, and the wiring 5086 _(—) j are electricallyconnected to a pixel 5080 _(—) i+1, j. In a similar manner, the wiring5084 _(—) i, a wiring 5085 _(—) j+1, and a wiring 5086 _(—) j+1 areelectrically connected to a pixel 5080 _(—) i, j+1. In a similar manner,the wiring 5084 _(—) i+1, the wiring 5085 _(—) j+1, and the wiring 5086_(—) j+1 are electrically connected to a pixel 5080 _(—) i+1, j+1. Notethat each wiring can be used in common with a plurality of pixels in thesame row or the same column. In the pixel structure illustrated in FIG.17C, the wiring 5087 is a counter electrode, which is used by all thepixels in common; therefore, the wiring 5087 is not indicated by thenatural number i or j. Note that since the pixel structure in FIG. 17Bcan also be used in one example of this embodiment, the wiring 5087 isnot required even in a structure where the wiring 5087 is provided andcan be eliminated when another wiring serves as the wiring 5087, forexample.

The pixel structure in FIG. 17C can be driven by a variety of methods.In particular, when the pixels are driven by a method called AC drive,deterioration (burn-in) of the liquid crystal element can be suppressed.FIG. 17D is a timing chart of voltage applied to each wiring in thepixel structure in FIG. 17C in the case where dot inversion driving,which is a kind of AC drive, is performed. By the dot inversion driving,flickers seen when the AC drive is performed can be suppressed.

In the pixel structure in FIG. 17C, a switch in a pixel electricallyconnected to the wiring 5085 _(—) j is selected (in an on state) in aj-th gate selection period in one frame period and is not selected (inan off state) in the other periods. Then, a (j+1)th gate selectionperiod is provided after the j-th gate selection period. By performingsequential scanning in this manner, all the pixels are sequentiallyselected in one frame period. In the timing chart of FIG. 17D, theswitch in the pixel is selected when the level of voltage is high, andthe switch is not selected when the level of the voltage is low. Notethat this is the case where the transistor in each pixel is an n-channeltransistor. In the case of using a p-channel transistor, a relationshipbetween voltage and a selection state is opposite to that in the case ofusing an n-channel transistor.

In the timing chart illustrated in FIG. 17D, in the j-th gate selectionperiod in a k-th frame (k is a natural number), positive signal voltageis applied to the wiring 5084 _(—) i used as a signal line, and negativesignal voltage is applied to the wiring 5084 _(—) i+1. Then, in the(j+1)th gate selection period in the k-th frame, negative signal voltageis applied to the wiring 5084 _(—) i, and positive signal voltage isapplied to the wiring 5084 _(—) i+1. After that, signals whosepolarities are inverted every gate selection period are alternatelysupplied to the signal line. Accordingly, in the k-th frame, thepositive signal voltage is applied to the pixels 5080 _(—) i, j and 5080_(—) i+1, j+1, and the negative signal voltage is applied to the pixels5080 _(—) i+1, j and 5080 _(—) i, j+1. Then, in a (k+1)th frame, signalvoltage whose polarity is opposite to that of the signal voltage writtenin the kth frame is written to each pixel. Accordingly, in the (k+1)thframe, the positive signal voltage is applied to the pixels 5080 _(—)i+1, j and 5080 _(—) i, j+1, and the negative signal voltage is appliedto the pixels 5080 _(—) i, j and 5080 _(—) i+1, j+1. In this manner, thedot inversion driving is a driving method by which signal voltage whosepolarity is different between adjacent pixels is applied in the sameframe and the polarity of the voltage signal for the pixel is invertedevery one frame. By the dot inversion driving, flickers seen when theentire or part of an image to be displayed is uniform can be suppressedwhile deterioration of the liquid crystal element is suppressed. Notethat voltage applied to all the wirings 5086 including the wirings 5086_(—) j and 5086 _(—) j+1 can be fixed voltage. Note that although onlythe polarity of the signal voltage for the wirings 5084 is illustratedin the timing chart, the signal voltage can actually have a variety oflevels in the polarity illustrated. Note that here, the case where thepolarity is inverted per dot (per pixel) is described; however, thisembodiment is not limited to this, and the polarity can be inverted pera plurality of pixels. For example, the polarity of signal voltage to bewritten is inverted per two gate selection periods, so that powerconsumed in writing signal voltage can be reduced. Alternatively, thepolarity can be inverted per column (source line inversion) or per row(gate line inversion).

Note that fixed voltage may be applied to the second terminal of thecapacitor 5083 in the pixel 5080 in one frame period. Here, since thelevel of voltage applied to the wiring 5085 used as a scan line is lowin most of one frame period, which means that substantially constantvoltage is applied to the wiring 5085; therefore, the second terminal ofthe capacitor 5083 in the pixel 5080 may be connected to the wiring5085. FIG. 17E illustrates an example of a pixel structure which can beused in the liquid crystal display device. Compared to the pixelstructure in FIG. 17C, a feature of the pixel structure in FIG. 17E liesin that the wiring 5086 is eliminated and the second terminal of thecapacitor 5083 in the pixel 5080 and the wiring 5085 in the previous roware electrically connected to each other. Specifically, in the rangeillustrated in FIG. 17E, the second terminals of the capacitors 5083 inthe pixels 5080 _(—) i, j+1 and 5080_(—) i+1, j+1 are electricallyconnected to the wiring 5085 _(—) j. By electrically connecting thesecond terminal of the capacitor 5083 in the pixel 5080 and the wiring5085 in the previous row to each other in this manner, the wiring 5086can be eliminated, so that the aperture ratio of the pixel can beincreased. Note that the second terminal of the capacitor 5083 may beconnected to the wiring 5085 in another row instead of in the previousrow. Note that the pixel structure in FIG. 17E can be driven by adriving method which is similar to that in the pixel structure in FIG.17C.

Note that voltage applied to the wiring 5084 used as a signal line canbe lowered by using the capacitor 5083 and the wiring electricallyconnected to the second terminal of the capacitor 5083. A pixelstructure and a driving method in this case are described with referenceto FIGS. 17F and 17G. Compared to the pixel structure in FIG. 17A, afeature of the pixel structure in FIG. 17F lies in that two wirings 5086are provided per pixel column, and in adjacent pixels, one wiring iselectrically connected to every other second terminal of the capacitors5083 and the other wiring is electrically connected to the remainingevery other second terminal of the capacitors 5083. Note that twowirings 5086 are referred to as a wiring 5086-1 and a wiring 5086-2.Specifically, in the range illustrated in FIG. 17F, the second terminalof the capacitor 5083 in the pixel 5080 _(—) i, j is electricallyconnected to a wiring 5086-1 _(—) j; the second terminal of thecapacitor 5083 in the pixel 5080 _(—) i+1, j is electrically connectedto a wiring 5086-2 _(—) j; the second terminal of the capacitor 5083 inthe pixel 5080 _(—) i, j+1 is electrically connected to a wiring 5086-2_(—) j+1; and the second terminal of the capacitor 5083 in the pixel5080 _(—) i+1, j+1 is electrically connected to a wiring 5086-1 _(—)j+1.

For example, when positive signal voltage is written to the pixel 5080_(—) i, j in the k-th frame as illustrated in FIG. 17G, the wiring5086-1 _(—) j becomes a low level, and is changed to a high level afterthe j-th gate selection period. Then, the wiring 5086-1 j is kept at ahigh level in one frame period, and after negative signal voltage iswritten in the j-th gate selection period in the (k+1)th frame, thewiring 5086-1 _(—) j is changed to a high level. In this manner, voltageof the wiring which is electrically connected to the second terminal ofthe capacitor 5083 is changed in a positive direction after positivesignal voltage is written to the pixel, so that voltage applied to theliquid crystal element can be changed in the positive direction by apredetermined level. That is, signal voltage written to the pixel can belowered by the predetermined level, so that power consumed in signalwriting can be reduced. Note that when negative signal voltage iswritten in the j-th gate selection period, voltage of the wiring whichis electrically connected to the second terminal of the capacitor 5083is changed in a negative direction after negative signal voltage iswritten to the pixel. Thus, voltage applied to the liquid crystalelement can be changed in the negative direction by a predeterminedlevel, and the signal voltage written to the pixel can be reduced as inthe case of the positive polarity. In other words, as for the wiringwhich is electrically connected to the second terminal of the capacitor5083, different wirings are preferably used for a pixel to whichpositive signal voltage is applied and a pixel to which negative signalvoltage is applied in the same row of the same frame. FIG. 17Fillustrates an example in which the wiring 5086-1 is electricallyconnected to the pixel to which positive signal voltage is applied inthe k-th frame and the wiring 5086-2 is electrically connected to thepixel to which negative signal voltage is applied in the k-th frame.Note that this is just an example, and for example, in the case of usinga driving method by which pixels to which positive signal voltage iswritten and pixels to which negative signal voltage is written appearevery two pixels, it is preferable to perform electrical connectionswith the wirings 5086-1 and 5086-2 alternately every two pixels.Further, in the case where signal voltage of the same polarity iswritten to all the pixels in one row (gate line inversion), one wiring5086 may be provided per row. In other words, in the pixel structure inFIG. 17C, the driving method by which signal voltage written to a pixelis lowered as described with reference to FIGS. 17F and 17G can be used.

Next, a pixel structure and a driving method which are preferably usedparticularly in the case where the mode of a liquid crystal element is avertical alignment (VA) mode typified by an MVA mode and a PVA mode. TheVA mode has advantages such as no rubbing step in manufacture, littlelight leakage at the time of black display, and low driving voltage, buthas a problem in that image quality is decreased (the viewing angle isnarrower) when a screen is seen from an oblique angle. In order to widenthe viewing angle in the VA mode, a pixel structure where one pixelincludes a plurality of subpixels as illustrated in FIGS. 18A and 18B iseffective. Pixel structures illustrated in FIGS. 18A and 18B areexamples of the case where the pixel 5080 includes two subpixels (asubpixel 5080-1 and a subpixel 5080-2). Note that the number ofsubpixels in one pixel is not limited to two and can be other numbers.The viewing angle can be further widened as the number of subpixelsbecomes larger. A plurality of subpixels can have the same circuitstructure. Here, all the subpixels have the circuit structureillustrated in FIG. 17A. Note that the first subpixel 5080-1 includes atransistor 5081-1, a liquid crystal element 5082-1, and a capacitor5083-1. The connection relation of each element is the same as that inthe circuit structure in FIG. 17A. In a similar manner, the secondsubpixel 5080-2 includes a transistor 5081-2, a liquid crystal element5082-2, and a capacitor 5083-2. The connection relation of each elementis the same as that in the circuit structure in FIG. 17A.

The pixel structure in FIG. 18A includes, for two subpixels included inone pixel, two wirings 5085 (a wiring 5085-1 and a wiring 5085-2) usedas scan lines, one wiring 5084 used as a signal line, and one wiring5086 used as a capacitor line. When the signal line and the capacitorline are shared between two subpixels in this manner, the aperture ratiocan be improved. Further, since a signal line driver circuit can besimplified, manufacturing cost can be reduced. Furthermore, since thenumber of connections between a liquid crystal panel and a drivercircuit IC can be reduced, yield can be improved. The pixel structure inFIG. 18B includes, for two subpixels included in one pixel, one wiring5085 used as a scan line, two wirings 5084 (a wiring 5084-1 and a wiring5084-2) used as signal lines, and one wiring 5086 used as a capacitorline. When the scan line and the capacitor line are shared between twosubpixels in this manner, the aperture ratio can be improved. Further,since the total number of scan lines can be reduced, the length of eachgate line selection period can be sufficiently increased even in ahigh-definition liquid crystal panel, and appropriate signal voltage canbe written to each pixel.

FIGS. 18C and 18D illustrate an example in which the liquid crystalelement in the pixel structure in FIG. 18B is replaced with the shape ofa pixel electrode and the electrical connection of each element isschematically illustrated. In FIGS. 18C and 18D, an electrode 5088-1corresponds to a first pixel electrode, and an electrode 5088-2corresponds to a second pixel electrode. In FIG. 18C, the first pixelelectrode 5088-1 corresponds to a first terminal of the liquid crystalelement 5082-1 in FIG. 18B, and the second pixel electrode 5088-2corresponds to a first terminal of the liquid crystal element 5082-2 inFIG. 18B. That is, the first pixel electrode 5088-1 is electricallyconnected to one of a source and a drain of the transistor 5081-1, andthe second pixel electrode 5088-2 is electrically connected to one of asource and a drain of the transistor 5081-2. Meanwhile, in FIG. 18D, theconnection relation between the pixel electrode and the transistor isopposite to that in FIG. 18C. That is, the first pixel electrode 5088-1is electrically connected to one of the source and the drain of thetransistor 5081-2, and the second pixel electrode 5088-2 is electricallyconnected to one of the source and the drain of the transistor 5081-1.

By alternately arranging a plurality of pixel structures as illustratedin FIG. 18C and FIG. 18D in matrix, special advantageous effects can beobtained. FIGS. 18E and 18F illustrate examples of the pixel structureand a driving method thereof. In the pixel structure in FIG. 18E, aportion corresponding to the pixels 5080 _(—) i,j and 5080 _(—) i+1, j+1has the structure illustrated in FIG. 18C, and a portion correspondingto the pixels 5080 _(—) i+1, j and 5080 _(—) i, j+1 has the structureillustrated in FIG. 18D. In this structure, by performing driving as thetiming chart illustrated in FIG. 18F, in the j-th gate selection periodin the k-th frame, positive signal voltage is written to the first pixelelectrode in the pixel 5080 _(—) i, j and the second pixel electrode inthe pixel 5080 _(—) i+1, j, and negative signal voltage is written tothe second pixel electrode in the pixel 5080 _(—) i, j and the firstpixel electrode in the pixel 5080 _(—) i+1, j. In the (j+1)th gateselection period in the k-th frame, positive signal voltage is writtento the second pixel electrode in the pixel 5080 _(—) i, j+1 and thefirst pixel electrode in the pixel 5080 _(—) i+1, j+1, and negativesignal voltage is written to the first pixel electrode in the pixel 5080_(—) i+1, j+1 and the second pixel electrode in the pixel 5080 _(—) i+1,j+1. In the (k+1)th frame, the polarity of signal voltage is inverted ineach pixel. Thus, the polarity of voltage applied to the signal line canbe the same in one frame period while driving corresponding to dotinversion driving is realized in the pixel structure includingsubpixels. Therefore, power consumed in writing signal voltage to thepixels can be drastically reduced. Note that voltage applied to all thewirings 5086 including the wirings 5086 _(—) j and 5086 _(—) j+1 can befixed voltage.

Further, by a pixel structure and a driving method illustrated in FIGS.18G and 18H, the level of signal voltage written to a pixel can belowered. In the structure, capacitors lines which are electricallyconnected to a plurality of subpixels included in each pixel aredifferent between the subpixels. That is, by using the pixel structureand the driving method illustrated in FIGS. 18G and 18H, subpixels towhich voltages having the same polarities are written in the same frameshare a capacitor line in the same row, and subpixels to which voltageshaving different polarities are written in the same frame use differentcapacitor lines in the same row. Then, when writing in each row isterminated, voltage of the capacitor lines is changed to the positivedirection in the subpixels to which positive signal voltage is written,and changed to the negative direction in the subpixels to which negativesignal voltage is written. Thus, the level of the signal voltage writtento the pixel can be lowered. Specifically, two wirings 5086 (the wirings5086-1 and 5086-2) used as capacitor lines are provided in each row. Thefirst pixel electrode in the pixel 5080 _(—) i, j and the wiring 5086-1_(—) j are electrically connected to each other through the capacitor.The second pixel electrode in the pixel 5080 _(—) i, j and the wiring5086-2 _(—) j are electrically connected to each other through thecapacitor. The first pixel electrode in the pixel 5080 _(—) i+1, j andthe wiring 5086-2 _(—) j are electrically connected to each otherthrough the capacitor. The second pixel electrode in the pixel 5080 _(—)i+1, j and the wiring 5086-1 _(—) j are electrically connected to eachother through the capacitor. The first pixel electrode in the pixel 5080_(—) i, j+1 and the wiring 5086-2 _(—) j+1 are electrically connected toeach other through the capacitor. The second pixel electrode in thepixel 5080 _(—) i, j+1 and the wiring 5086-1 _(—) j+1 are electricallyconnected to each other through the capacitor. The first pixel electrodein the pixel 5080 _(—) i+1, j+1 and the wiring 5086-1 _(—) j+1 areelectrically connected to each other through the capacitor. The secondpixel electrode in the pixel 5080 _(—) i+1, j+1 and the wiring 5086-2_(—) j+1 are electrically connected to each other through the capacitor.Note that this is just an example, and for example, in the case of usinga driving method by which pixels to which positive signal voltage iswritten and pixels to which negative signal voltage is written appearevery two pixels, it is preferable to perform electrical connectionswith the wirings 5086-1 and 5086-2 alternately every two pixels.Further, in the case where signal voltage of the same polarity iswritten in all the pixels in one row (gate line inversion), one wiring5086 may be provided per row. In other words, in the pixel structure inFIG. 18E, the driving method by which signal voltage written to a pixelis lowered as described with reference to FIGS. 18G and 18H can be used.

Embodiment 9

In this embodiment, examples of display devices are described.

First, an example of a system block of a liquid crystal display deviceis described with reference to FIG. 19A. The liquid crystal displaydevice includes a circuit 5361, a circuit 5362, a circuit 5363_1, acircuit 5363_2, a pixel portion 5364, a circuit 5365, and a lightingdevice 5366. A plurality of wirings 5371 which are extended from thecircuit 5362 and a plurality of wirings 5372 which are extended from thecircuit 5363_1 and the circuit 5363_2 are provided in the pixel portion5364. In addition, pixels 5367 which include display elements such asliquid crystal elements are provided in matrix in respective regionswhere the plurality of wirings 5371 and the plurality of wirings 5372intersect with each other.

The circuit 5361 has a function of outputting a signal, voltage,current, or the like to the circuit 5362, the circuit 5363_1, thecircuit 5363_2, and the circuit 5365 in response to a video signal 5360and can serve as a controller, a control circuit, a timing generator, apower supply circuit, a regulator, or the like. In this embodiment, forexample, the circuit 5361 supplies a signal line driver circuit startsignal (SSP), a signal line driver circuit clock signal (SCK), a signalline driver circuit inverted clock signal (SCKB), video signal data(DATA), or a latch signal (LAT) to the circuit 5362. Alternatively, forexample, the circuit 5361 supplies a scan line driver circuit startsignal (GSP), a scan line driver circuit clock signal (GCK), or a scanline driver circuit inverted clock signal (GCKB) to the circuit 5363_1and the circuit 5363_2. Alternatively, the circuit 5361 outputs abacklight control signal (BLC) to the circuit 5365. Note that thisembodiment is not limited to this. The circuit 5361 can supply a varietyof signals, voltages, currents, or the like to the circuit 5362, thecircuit 5363_1, the circuit 5363_2, and the circuit 5365.

Note that in the circuit 5361, super-resolution processing, edgeenhancement processing, frame interpolation processing, overdriveprocessing, local dimming processing, IP conversion processing, and/orenlargement processing can be performed, for example.

Note that in the circuit 5365, local dimming processing or the like canbe performed. Alternatively, in the circuit 5365, processing fordetermining the luminance of a backlight in each region in local dimmingprocessing can be performed.

Note that in the circuit 5361 or the circuit 5365, a variety ofprocessings can be performed. Therefore, the circuit 5361 or the circuit5365 can include more circuits. That is, the circuit 5361 or the circuit5365 can be formed using a plurality of circuits. In that case, theplurality of circuits included in the circuit 5361 or the circuit 5365can be formed over one IC chip. Note that one example of this embodimentis not limited to this. The plurality of circuits included in thecircuit 5361 or the circuit 5365 can be formed over a plurality ofdifferent IC chips. In that case, the circuit 5361 or the circuit 5365can be formed using a plurality of IC chips.

In that case, the circuit 5362 has a function of outputting videosignals to the plurality of wirings 5371 in response to a signalsupplied from the circuit 5361 (e.g., SSP, SCK, SCKB, DATA, or LAT) andcan serve as a signal line driver circuit. The circuit 5363_1 and thecircuit 5363_2 each have a function of outputting scan signals to theplurality of wirings 5372 in response to a signal supplied from thecircuit 5361 (e.g., GSP, GCK, or GCKB) and can serve as a scan linedriver circuit. The circuit 5365 has a function of controlling theluminance (or average luminance) of the lighting device 5366 bycontrolling the amount of electric power supplied to the lighting device5366, time to supply the electric power to the lighting device 5366, orthe like in response to the backlight control signal (BLC) and can serveas a power supply circuit.

Note that in the case where video signals are input to the plurality ofwirings 5371, the plurality of wirings 5371 can serve as signal lines,video signal lines, source lines, or the like. In the case where scansignals are input to the plurality of wirings 5372, the plurality ofwirings 5372 can serve as signal lines, scan lines, gate lines, or thelike. Note that one example of this embodiment is not limited to this.

Note that in the case where the same signal is input to the circuit5363_1 and the circuit 5363_2 from the circuit 5361, scan signals outputfrom the circuit 5363_1 to the plurality of wirings 5372 and scansignals output from the circuit 5363_2 to the plurality of wirings 5372have approximately the same timings in many cases. Therefore, loadcaused by driving of the circuit 5363_1 and the circuit 5363_2 can bereduced. Accordingly, the display device can be made larger.Alternatively, the display device can have higher definition.Alternatively, since the channel width of transistors included in thecircuit 5363_1 and the circuit 5363_2 can be decreased, a display devicewith a narrower frame can be obtained. Note that this embodiment is notlimited to this. The circuit 5361 can supply different signals to thecircuit 5363_1 and the circuit 5363_2.

Note that one of the circuit 5363_1 and the circuit 5363_2 can beeliminated.

Note that a wiring such as a capacitor line, a power supply line, or ascan line can be additionally provided in the pixel portion 5364. Then,the circuit 5361 can output a signal, voltage, or the like to such awiring. Alternatively, a circuit which is similar to the circuit 5363_1or the circuit 5363_2 can be additionally provided. The additionallyprovided circuit can output a signal such as a scan signal to theadditionally provided wiring.

Note that the pixel 5367 can include a light-emitting element such as anEL element as a display element. In this case, as illustrated in FIG.198, since the display element can emit light, the circuit 5365 and thelighting device 5366 can be eliminated. In addition, in order to supplyelectric power to the display element, a plurality of wirings 5373 whichcan serve as power supply lines can be provided in the pixel portion5364. The circuit 5361 can supply power supply voltage called voltage(ANO) to the wirings 5373. The wirings 5373 can be separately connectedto the pixels in accordance with color elements or connected to all thepixels.

Note that FIG. 19B illustrates an example in which the circuit 5361supplies different signals to the circuit 5363_1 and the circuit 5363_2.The circuit 5361 supplies a signal such as a scan line driver circuitstart signal (GSP1), a scan line driver circuit clock signal (GCK1), ora scan line driver circuit inverted clock signal (GCKB1) to the circuit5363_1. In addition, the circuit 5361 supplies a signal such as a scanline driver circuit start signal (GSP2), a scan line driver circuitclock signal (GCK2), or a scan line driver circuit inverted clock signal(GCKB2) to the circuit 5363_2. In this case, the circuit 5363_1 can scanonly wirings in odd-numbered rows of the plurality of wirings 5372 andthe circuit 5363_2 can scan only wirings in even-numbered rows of theplurality of wirings 5372. Thus, the driving frequency of the circuit5363_1 and the circuit 5363_2 can be lowered, so that power consumptioncan be reduced. Alternatively, an area in which a flip-flop of one stagecan be laid out can be made larger. Therefore, a display device can havehigher definition. Alternatively, a display device can be made larger.Note that this embodiment is not limited to this. As in FIG. 19A, thecircuit 5361 can supply the same signal to the circuit 5363_1 and thecircuit 5363_2.

Note that as in FIG. 19B, the circuit 5361 can supply different signalsto the circuit 5363_1 and the circuit 5363_2 in FIG. 19A.

Thus far, the example of a system block of a display device isdescribed.

Next, examples of structures of the display devices are described withreference to FIGS. 20A to 20E.

In FIG. 20A, circuits which have a function of outputting signals to thepixel portion 5364 (e.g., the circuit 5362, the circuit 5363_1, and thecircuit 5363_2) are formed over the same substrate 5380 as the pixelportion 5364. In addition, the circuit 5361 is formed over a differentsubstrate from the pixel portion 5364. In this mariner, since the numberof external components is reduced, reduction in cost can be achieved.Alternatively, since the number of signals or voltages input to thesubstrate 5380 is reduced, the number of connections between thesubstrate 5380 and the external component can be reduced. Therefore,improvement in reliability or the increase in yield can be achieved.

Note that in the case where the circuit is formed over a differentsubstrate from the pixel portion 5364, the substrate can be mounted onan FPC (flexible printed circuit) by TAB (tape automated bonding).Alternatively, the substrate can be mounted on the same substrate 5380as the pixel portion 5364 by COG (chip on glass).

Note that in the case where the circuit is formed over a differentsubstrate from the pixel portion 5364, a transistor formed using asingle crystal semiconductor can be formed on the substrate. Therefore,the circuit formed over the substrate can have advantages such asimprovement in driving frequency, improvement in driving voltage, andsuppression of variations in output signals.

Note that a signal, voltage, current, or the like is input from anexternal circuit through an input terminal 5381 in many cases.

In FIG. 20B, circuits with low driving frequency (e.g., the circuit5363_1 and the circuit 5363_2) are formed over the same substrate 5380as the pixel portion 5364. In addition, the circuit 5361 and the circuit5362 are formed over a different substrate from the pixel portion 5364.In this manner, since the circuit formed over the substrate 5380 can beformed using a transistor with low mobility, a non-single-crystalsemiconductor, a microcrystalline semiconductor, an organicsemiconductor, an oxide semiconductor, or the like can be used for asemiconductor layer of the transistor. Accordingly, the increase in thesize of the display device, reduction in the number of steps, reductionin cost, improvement in yield, or the like can be achieved.

Note that as illustrated in FIG. 20C, part of the circuit 5362 (acircuit 5362 a) can be formed over the same substrate 5380 as the pixelportion 5364 and the other part of the circuit 5362 (a circuit 5362 b)can be formed over a different substrate from the pixel portion 5364.The circuit 5362 a includes a circuit which can be formed using atransistor with low mobility (e.g., a shift register, a selector, or aswitch) in many cases. In addition, the circuit 5362 b includes acircuit which is preferably formed using a transistor with high mobilityand few variations in characteristics (e.g., a shift register, a latchcircuit, a buffer circuit, a DA converter circuit, or an AD convertercircuit) in many cases. In this manner, as in FIG. 20B, anon-single-crystal semiconductor, a microcrystalline semiconductor, anorganic semiconductor, an oxide semiconductor, or the like can be usedfor a semiconductor layer of the transistor. Further, reduction inexternal components can be achieved.

In FIG. 20D, circuits which have a function of outputting signals to thepixel portion 5364 (e.g., the circuit 5362, the circuit 5363_1, and thecircuit 5363_2) and a circuit which has a function of controlling thesecircuits (e.g., the circuit 5361) are formed over a different substratefrom the pixel portion 5364. In this manner, since the pixel portion andperipheral circuits thereof can be formed over different substrates,improvement in yield can be achieved.

Note that as in FIG. 20D, the circuit 5363_1 and the circuit 5363_2 canbe formed over a different substrate from the pixel portion 5364 inFIGS. 20A to 20C.

In FIG. 20E, part of the circuit 5361 (a circuit 5361 a) is formed overthe same substrate 5380 as the pixel portion 5364 and the other part ofthe circuit 5361 (a circuit 5361 b) is formed over a different substratefrom the pixel portion 5364. The circuit 5361 a includes a circuit whichcan be formed using a transistor with low mobility (e.g., a switch, aselector, or a level shift circuit) in many cases. In addition, thecircuit 5361 b includes a circuit which is preferably formed using atransistor with high mobility and few variations (e.g., a shiftregister, a timing generator, an oscillator, a regulator, or an analogbuffer) in many cases.

Note that also in FIGS. 20A to 20D, the circuit 5361 a can be formedover the same substrate as the pixel portion 5364 and the circuit 5361 bcan be formed over a different substrate from the pixel portion 5364.

Embodiment 10

In this embodiment, examples of structures of transistors are describedwith reference to FIGS. 21A to 21C.

FIG. 21A illustrates an example of a structure of a top-gate transistor.FIG. 21B illustrates an example of a structure of a bottom-gatetransistor. FIG. 21C illustrates an example of a structure of atransistor formed using a semiconductor substrate.

FIG. 21A illustrates a substrate 5260; an insulating layer 5261 formedover the substrate 5260; a semiconductor layer 5262 which is formed overthe insulating layer 5261 and is provided with a region 5262 a, a region5262 b, a region 5262 c, a region 5262 d, and a region 5262 e; aninsulating layer 5263 formed so as to cover the semiconductor layer5262; a conductive layer 5264 formed over the semiconductor layer 5262and the insulating layer 5263; an insulating layer 5265 which is formedover the insulating layer 5263 and the conductive layer 5264 and isprovided with openings; a conductive layer 5266 which is formed over theinsulating layer 5265 and in the openings formed in the insulating layer5265; an insulating layer 5267 which is formed over the conductive layer5266 and the insulating layer 5265 and is provided with an opening; aconductive layer 5268 which is formed over the insulating layer 5267 andin the opening formed in the insulating layer 5267; an insulating layer5269 which is formed over the insulating layer 5267 and the conductivelayer 5268 and is provided with the opening; a light-emitting layer 5270which is formed over the insulating layer 5269 and in the opening formedin the insulating layer 5269; and a conductive layer 5271 formed overthe insulating layer 5269 and the light-emitting layer 5270.

FIG. 21B illustrates a substrate 5300; a conductive layer 5301 formedover the substrate 5300; an insulating layer 5302 formed so as to coverthe conductive layer 5301; a semiconductor layer 5303 a formed over theconductive layer 5301 and the insulating layer 5302; a semiconductorlayer 5303 b formed over the semiconductor layer 5303 a; a conductivelayer 5304 formed over the semiconductor layer 5303 b and the insulatinglayer 5302; an insulating layer 5305 which is formed over the insulatinglayer 5302 and the conductive layer 5304 and is provided with anopening; a conductive layer 5306 which is formed over the insulatinglayer 5305 and in the opening formed in the insulating layer 5305; aliquid crystal layer 5307 formed over the insulating layer 5305 and theconductive layer 5306; and a conductive layer 5308 formed over theliquid crystal layer 5307.

FIG. 21C illustrates a semiconductor substrate 5352 including a region5353 and a region 5355; an insulating layer 5356 formed over thesemiconductor substrate 5352; an insulating layer 5354 formed over thesemiconductor substrate 5352; a conductive layer 5357 formed over theinsulating layer 5356; an insulating layer 5358 which is formed over theinsulating layer 5354, the insulating layer 5356, and the conductivelayer 5357 and is provided with openings; and a conductive layer 5359which is formed over the insulating layer 5358 and in the openingsformed in the insulating layer 5358. Thus, a transistor is formed ineach of a region 5350 and a region 5351.

The insulating layer 5261 can serve as a base film. The insulating layer5354 serves as an element isolation layer (e.g., a field oxide film).Each of the insulating layer 5263, the insulating layer 5302, and theinsulating layer 5356 can serve as a gate insulating film. Each of theconductive layer 5264, the conductive layer 5301, and the conductivelayer 5357 can serve as a gate electrode. Each of the insulating layer5265, the insulating layer 5267, the insulating layer 5305, and theinsulating layer 5358 can serve as an interlayer film or a planarizationfilm. Each of the conductive layer 5266, the conductive layer 5304, andthe conductive layer 5359 can serve as a wiring, an electrode of atransistor, an electrode of a capacitor, or the like. Each of theconductive layer 5268 and the conductive layer 5306 can serve as a pixelelectrode, a reflective electrode, or the like. The insulating layer5269 can serve as a partition wall. Each of the conductive layer 5271and the conductive layer 5308 can serve as a counter electrode, a commonelectrode, or the like.

As each of the substrate 5260 and the substrate 5300, a glass substrate,a quartz substrate, a silicon substrate, a metal substrate, a stainlesssteel substrate, a flexible substrate, or the like can be used, forexample. As a glass substrate, a barium borosilicate glass substrate, analuminoborosilicate glass substrate, or the like can be used, forexample. For a flexible substrate, a flexible synthetic resin such asplastics typified by polyethylene terephthalate (PET), polyethylenenaphthalate (PEN), and polyether sulfone (PES), or acrylic can be used,for example. Alternatively, an attachment film (formed usingpolypropylene, polyester, vinyl, polyvinyl fluoride, polyvinyl chloride,or the like), paper of a fibrous material, a base material film (formedusing polyester, polyamide, an inorganic vapor deposition film, paper,or the like), or the like can be used.

As the semiconductor substrate 5352, for example, a single crystalsilicon substrate having n-type or p-type conductivity can be used. Notethat this embodiment is not limited to this, and a substrate which issimilar to the substrate 5260 can be used. For example, the region 5353is a region where an impurity is added to the semiconductor substrate5352 and serves as a well. For example, in the case where thesemiconductor substrate 5352 has p-type conductivity, the region 5353has n-type conductivity and serves as an n-well. On the other hand, inthe case where the semiconductor substrate 5352 has n-type conductivity,the region 5353 has p-type conductivity and serves as a p-well. Forexample, the region 5355 is a region where an impurity is added to thesemiconductor substrate 5352 and serves as a source region or a drainregion. Note that an LDD region can be formed in the semiconductorsubstrate 5352.

For the insulating layer 5261, a single-layer structure or a layeredstructure of an insulating film containing oxygen or nitrogen, such assilicon oxide (SiO_(x)), silicon nitride (SiN_(x)), silicon oxynitride(SiO_(x)N_(y)) (x>y), or silicon nitride oxide (SiN_(x)O_(y)) (x>y) canbe used, for example. In an example in the case where the insulatingfilm 5261 has a two-layer structure, a silicon nitride film and asilicon oxide film can be formed as a first insulating film and a secondinsulating film, respectively. In an example in the case where theinsulating film 5261 has a three-layer structure, a silicon oxide film,a silicon nitride film, and a silicon oxide film can be formed as afirst insulating film, a second insulating film, and a third insulatingfilm, respectively.

For each of the semiconductor layer 5262, the semiconductor layer 5303a, and the semiconductor layer 5303 b, for example, a non-single-crystalsemiconductor (e.g., amorphous silicon, polycrystalline silicon, ormicrocrystalline silicon), a single crystal semiconductor, a compoundsemiconductor or an oxide semiconductor (e.g., ZnO, InGaZnO, SiGe, GaAs,IZO, ITO, or SnO), an organic semiconductor, a carbon nanotube, or thelike can be used.

Note that for example, the region 5262 a is an intrinsic region where animpurity is not added to the semiconductor layer 5262 and serves as achannel region. However, a slight amount of impurities can be added tothe region 5262 a. The concentration of the impurity added to the region5262 a is preferably lower than the concentration of an impurity addedto the region 5262 b, the region 5262 c, the region 5262 d, or theregion 5262 e. Each of the region 5262 b and the region 5262 d is aregion to which an impurity is added at low concentration and serves asan LDD (lightly doped drain) region. Note that the region 5262 b and theregion 5262 d can be eliminated. Each of the region 5262 c and theregion 5262 e is a region to which an impurity is added at highconcentration and serves as a source region or a drain region.

Note that the semiconductor layer 5303 b is a semiconductor layer towhich phosphorus or the like is added as an impurity element and hasn-type conductivity.

Note that in the case where an oxide semiconductor or a compoundsemiconductor is used for the semiconductor layer 5303 a, thesemiconductor layer 5303 b can be eliminated.

For each of the insulating layer 5263, the insulating layer 5302, andthe insulating layer 5356, a single-layer structure or a layeredstructure of an insulating film containing oxygen or nitrogen, such assilicon oxide (SiO_(x)), silicon nitride (SiN_(x)), silicon oxynitride(SiO_(x)N_(y)) (x>y), or silicon nitride oxide (SiN_(x)O_(y)) (x>y) canbe used, for example.

As each of the conductive layer 5264, the conductive layer 5266, theconductive layer 5268, the conductive layer 5271, the conductive layer5301, the conductive layer 5304, the conductive layer 5306, theconductive layer 5308, the conductive layer 5357, and the conductivelayer 5359, for example, a conductive film having a single-layerstructure or a layered structure, or the like can be used. For example,for the conductive film, a single-layer film containing one elementselected from the group consisting of aluminum (Al), tantalum (Ta),titanium (Ti), molybdenum (Mo), tungsten (W), neodymium (Nd), chromium(Cr), nickel (Ni), platinum (Pt), gold (Au), silver (Ag), copper (Cu),manganese (Mn), cobalt (Co), niobium (Nb), silicon (Si), iron (Fe),palladium (Pd), carbon (C), scandium (Sc), zinc (Zn), phosphorus (P),boron (B), arsenic (As), gallium (Ga), indium (In), tin (Sn), and oxygen(O); a compound containing one or more elements selected from the abovegroup; or the like can be used. For example, the compound is an alloycontaining one or more elements selected from the above group (e.g., analloy material such as indium tin oxide (ITO), indium zinc oxide (IZO),indium tin oxide containing silicon oxide (ITSO), zinc oxide (ZnO), tinoxide (SnO), cadmium tin oxide (CTO), aluminum-neodymium (Al—Nd),magnesium-silver (Mg—Ag), molybdenum-niobium (Mo—Nb),molybdenum-tungsten (Mo—W), or molybdenum-tantalum (Mo—Ta)); a compoundcontaining nitrogen and one or more elements selected from the abovegroup (e.g., a nitride film containing titanium nitride, tantalumnitride, molybdenum nitride, or the like); or a compound containingsilicon and one or more elements selected from the above group (e.g., asilicide film containing tungsten silicide, titanium silicide, nickelsilicide, aluminum silicon, or molybdenum silicon); or the like.Alternatively, a nanotube material such as a carbon nanotube, an organicnanotube, an inorganic nanotube, or a metal nanotube can be used.

Note that silicon (Si) can contain an n-type impurity (e.g., phosphorus)or a p-type impurity (e.g., boron).

Note that in the case where copper is used for the conductive layer, alayered structure is preferably used in order to improve adhesion.

Note that for a conductive layer which is in contact with an oxidesemiconductor or silicon, molybdenum or titanium is preferably used.

Note that by using an alloy material containing neodymium and aluminumfor the conductive layer, aluminum does not easily cause hillocks.

Note that in the case where a semiconductor material such as silicon isused for the conductive layer, the semiconductor material such assilicon can be formed at the same time as a semiconductor layer of atransistor.

Note that since ITO, IZO, ITSO, ZnO, Si, SnO, CTO, a carbon nanotube, orthe like has light-transmitting properties, such a material can be usedfor a portion through which light passes, such as a pixel electrode, acounter electrode, or a common electrode.

Note that by using a layered structure containing a low-resistancematerial (e.g., aluminum), wiring resistance can be lowered.

Note that by using a layered structure where a low heat-resistancematerial (e.g., aluminum) is interposed between high heat-resistancematerials (e.g., molybdenum, titanium, or neodymium), advantages of thelow heat-resistance material can be effectively utilized and heatresistance of a wiring, an electrode, or the like can be increased.

Note that a material whose properties are changed by reaction with adifferent material can be interposed between or covered with materialswhich do not easily react with the different material. For example, inthe case where ITO and aluminum are connected to each other, titanium,molybdenum, or an alloy of neodymium can be interposed between ITO andaluminum. For example, in the case where silicon and aluminum areconnected to each other, titanium, molybdenum, or an alloy of neodymiumcan be interposed between silicon and aluminum. Note that such amaterial can be used for a wiring, an electrode, a conductive layer, aconductive film, a terminal, a via, a plug, or the like.

For each of the insulating layer 5265, the insulating layer 5267, theinsulating layer 5269, the insulating layer 5305, and the insulatinglayer 5358, an insulating film having a single-layer structure or alayered structure, or the like can be used, for example. For example, asthe insulating film, an insulating film containing oxygen or nitrogen,such as silicon oxide (SiO_(x)), silicon nitride (SiN_(x)), siliconoxynitride (SiO_(x)N_(y)) (x>y), or silicon nitride oxide (SiN_(x)O_(y))(x>y); a film containing carbon such as diamond-like carbon (DLC); anorganic material such as a siloxane resin, epoxy, polyimide, polyamide,polyvinyl phenol, benzocyclobutene, or acrylic; or the like can be used.

For the light-emitting layer 5270, an organic EL element, an inorganicEL element, or the like can be used, for example. For the organic ELelement, for example, a single-layer structure or a layered structure ofa hole injection layer formed using a hole injection material, a holetransport layer formed using a hole transport material, a light-emittinglayer formed using a light-emitting material, an electron transportlayer formed using an electron transport material, an electron injectionlayer formed using an electron injection material, or a layer in which aplurality of these materials are mixed can be used.

For example, the following can be used for the liquid crystal layer5307: a nematic liquid crystal, a cholesteric liquid crystal, a smecticliquid crystal, a discotic liquid crystal, a thermotropic liquidcrystal, a lyotropic liquid crystal, a low-molecular liquid crystal, ahigh-molecular liquid crystal, a polymer dispersed liquid crystal(PDLC), a ferroelectric liquid crystal, an anti-ferroelectric liquidcrystal, a main-chain liquid crystal, a side-chain high-molecular liquidcrystal, a plasma addressed liquid crystal (PALC), a banana-shapedliquid crystal, and the like. In addition, the following can be used asa diving method of a liquid crystal: a TN (twisted nematic) mode, an STN(super twisted nematic) mode, an IPS (in-plane-switching) mode, an FFS(fringe field switching) mode, an MVA (multi-domain vertical alignment)mode, a PVA (patterned vertical alignment) mode, an ASV (advanced superview) mode, an ASM (axially symmetric aligned microcell) mode, an OCB(optically compensated birefringence) mode, an ECB (electricallycontrolled birefringence) mode, an FLC (ferroelectric liquid crystal)mode, an AFLC (anti-ferroelectric liquid crystal) mode, a PDLC (polymerdispersed liquid crystal) mode, a guest-host mode, a blue phase mode,and the like.

Note that an insulating layer which serves as an alignment film, aninsulating layer which serves as a protrusion portion, or the like canbe formed over the insulating layer 5305 and the conductive layer 5306.

Note that an insulating layer or the like which serves as a colorfilter, a black matrix, or a protrusion portion can be formed over theconductive layer 5308. An insulating layer which serves as an alignmentfilm can be formed below the conductive layer 5308.

Note that the insulating layer 5269, the light-emitting layer 5270, andthe conductive layer 5271 can be eliminated in the cross-sectionalstructure in FIG. 21A, and the liquid crystal layer 5307 and theconductive layer 5308 which are illustrated in FIG. 21B can be formedover the insulating layer 5267 and the conductive layer 5268.

Note that the liquid crystal layer 5307 and the conductive layer 5308can be eliminated in the cross-sectional structure in FIG. 21B, and theinsulating layer 5269, the light-emitting layer 5270, and the conductivelayer 5271 which are illustrated in FIG. 21A can be formed over theinsulating layer 5305 and the conductive layer 5306.

Note that in the cross-sectional structure in FIG. 21C, the insulatinglayer 5269, the light-emitting layer 5270, and the conductive layer 5271which are illustrated in FIG. 21A can be formed over the insulatinglayer 5358 and the conductive layer 5359. Alternatively, the liquidcrystal layer 5307 and the conductive layer 5308 which are illustratedin FIG. 21B can be formed over the insulating layer 5267 and theconductive layer 5268.

Embodiment 11

In this embodiment, examples of electronic devices are described.

FIGS. 22A to 22H and FIGS. 23A to 23D illustrate electronic devices.These electronic devices can include a housing 5000, a display portion5001, a speaker 5003, an LED lamp 5004, operation keys 5005 (including apower switch or an operation switch), a connection terminal 5006, asensor 5007 (a sensor having a function of measuring force,displacement, position, speed, acceleration, angular velocity,rotational frequency, distance, light, liquid, magnetism, temperature,chemical substance, sound, time, hardness, electric field, current,voltage, electric power, radiation, flow rate, humidity, gradient,oscillation, odor, or infrared ray), a microphone 5008, and the like.

FIG. 22A illustrates a mobile computer, which can include a switch 5009,an infrared port 5010, and the like in addition to the above objects.FIG. 22B illustrates a portable image regenerating device provided witha memory medium (e.g., a DVD regenerating device), which can include asecond display portion 5002, a memory medium reading portion 5011, andthe like in addition to the above objects. FIG. 22C illustrates agoggle-type display, which can include the second display portion 5002,a support portion 5012, an earphone 5013, and the like in addition tothe above objects. FIG. 22D illustrates a portable game machine, whichcan include the memory medium reading portion 5011 and the like inaddition to the above objects. FIG. 22E illustrates a projector, whichcan include a light source 5033, a projector lens 5034, and the like inaddition to the above objects. FIG. 22F illustrates a portable gamemachine, which can include the second display portion 5002, the memorymedium reading portion 5011, and the like in addition to the aboveobjects. FIG. 22G illustrates a television receiver, which can include atuner, an image processing portion, and the like in addition to theabove objects. FIG. 22H illustrates a portable television receiver,which can include a charger 5017 capable of transmitting and receivingsignals and the like in addition to the above objects. FIG. 23Aillustrates a display, which can include a support base 5018 and thelike in addition to the above objects. FIG. 23B illustrates a camera,which can include an external connecting port 5019, a shutter button5015, an image receiving portion 5016, and the like in addition to theabove objects. FIG. 23C illustrates a computer, which can include apointing device 5020, the external connecting port 5019, a reader/writer5021, and the like in addition to the above objects. FIG. 23Dillustrates a mobile phone, which can include an antenna 5014, a tunerof one-segment (1 seg digital TV broadcasts) partial reception servicefor mobile phones and mobile terminals, and the like in addition to theabove objects.

The electronic devices illustrated in FIGS. 22A to 22H and FIGS. 23A to23D can have a variety of functions, for example, a function ofdisplaying a lot of information (e.g., a still image, a moving image,and a text image) on a display portion; a touch panel function; afunction of displaying a calendar, date, time, and the like; a functionof controlling processing with a lot of software (programs); a wirelesscommunication function; a function of being connected to a variety ofcomputer networks with a wireless communication function; a function oftransmitting and receiving a lot of data with a wireless communicationfunction; and a function of reading a program or data stored in a memorymedium and displaying the program or data on a display portion. Further,the electronic device including a plurality of display portions can havea function of displaying image information mainly on one display portionwhile displaying text information on another display portion, a functionof displaying a three-dimensional image by displaying images whereparallax is considered on a plurality of display portions, or the like.Furthermore, the electronic device including an image receiving portioncan have a function of photographing a still image, a function ofphotographing a moving image, a function of automatically or manuallycorrecting a photographed image, a function of storing a photographedimage in a memory medium (an external memory medium or a memory mediumincorporated in the camera), a function of displaying a photographedimage on the display portion, or the like. Note that functions which canbe provided for the electronic devices illustrated in FIGS. 22A to 22Hand FIGS. 23A to 23D are not limited them, and the electronic devicescan have a variety of functions.

The electronic devices described in this embodiment each include adisplay portion for displaying some kind of information.

Next, applications of semiconductor devices are described.

FIG. 23E illustrates an example in which a semiconductor device isincorporated in a building structure. FIG. 23E illustrates a housing5022, a display portion 5023, a remote controller 5024 which is anoperation portion, a speaker 5025, and the like. The semiconductordevice is incorporated in the building structure as a wall-hanging typeand can be provided without requiring a large space.

FIG. 23F illustrates another example in which a semiconductor device isincorporated in a building structure. A display panel 5026 isincorporated in a prefabricated bath unit 5027, so that a bather canview the display panel 5026.

Note that although this embodiment describes the wall and theprefabricated bath are given as examples of the building structures,this embodiment is not limited to them. The semiconductor devices can beprovided in a variety of building structures.

Next, examples in which semiconductor devices are incorporated in movingobjects are described.

FIG. 23G illustrates an example in which a semiconductor device isincorporated in a car. A display panel 5028 is incorporated in a carbody 5029 of the car and can display information related to theoperation of the car or information input from inside or outside of thecar on demand. Note that the display panel 5028 may have a navigationfunction.

FIG. 23H illustrates an example in which a semiconductor device isincorporated in a passenger airplane. FIG. 23H illustrates a usagepattern when a display panel 5031 is provided for a ceiling 5030 above aseat of the passenger airplane. The display panel 5031 is incorporatedin the ceiling 5030 through a hinge portion 5032, and a passenger canview the display panel 5031 by stretching of the hinge portion 5032. Thedisplay panel 5031 has a function of displaying information by theoperation of the passenger.

Note that although bodies of a car and an airplane are illustrated asexamples of moving objects in this embodiment, this embodiment is notlimited to them. The semiconductor devices can be provided for a varietyof objects such as two-wheeled vehicles, four-wheeled vehicles(including cars, buses, and the like), trains (including monorails,railroads, and the like), and vessels.

This application is based on Japanese Patent Application serial no.2009-025966 filed with Japan Patent Office on Feb. 6, 2009, the entirecontents of which are hereby incorporated by reference.

EXPLANATION OF REFERENCE

101: circuit, 102: circuit, 102 a: circuit, 102 b: circuit, 103 a:switch 103 b: switch, 104 a: switch, 104 b: switch, 301: region, 302:region, 303: region, 1001: device, 1002: point light source, 1003:partition, 1004: partition, 1005: spacer, 1006: pitch in longitudinaldirection, 1007: pitch in lateral direct on, 1011: diffusing plate,1012: display panel, 1013: height, 1014: height, 1015: distance, 1102:planar light source, 1103: line light source, 1104: light guide plate,1105: bottom surface, 1106: fluor scent tube su (cathode tube), 1107:diffusing plate, 5000: housing, 5001: display portion, 5002: seconddisplay portion, 5003: speaker, 5004: LED lamp, 5005: operation key,5006: connection terminal, 5007: sensor, 5008: microphone, 5009: switch,5010: infrared port, 5011: recording medium reading portion, 5012:support portion, 5013: earphone, 5015: shutter button, 5016: imagereceiving portion, 5018: support base, 5019: external connection port,5020: pointing device, 5021: reader/writer, 5022: housing, 5023: displayportion, 5024: remote controller, 5025: speaker, 5026: display panel,5027: prefabricated bath unit, 5028: display panel, 5029: car body,5030: ceiling, 5031: display panel, 5032: hinge portion, 5033: lightsource, 5034: projector lens, 5080: pixel, 5081: transistor, 5082:liquid crystal element, 5083: capacitor, 5084: wiring, 5085: wiring,5086: wiring, 5087: wiring, 5101: dashed line, 5102: solid line, 5103:dashed line, 5104: solid line, 5105: solid line, 5106: solid line, 5107:solid line, 5108: solid line, 5121: image, 5121 a: image, 5121 b: image,5122: image, 5122 a: image, 5122 b: image, 5123: image, 5123 a: image,5123 b: image, 5124: region, 5125: region, 5126: region, 5127: motionvector, 5128: image, generation vector, 5129: region, 5130: object,5131: region, 5260: substrate, 5261: insulating layer 5262:semiconductor layer, 5262 a: region, 5262 b: region, 5262 c: region,5262 d: region, 5262 e: region, 5263: insulating layer, 5264: conductivelayer, 5265: insulating layer, 5266: conductive layer, 5267 insulatinglayer, 5268: conductive layer, 5269: insulating layer, 5270:light-emitting layer, 5271: conductive layer, 5273: insulating layer,5300: substrate, 5301: conductive layer, 5302: insulating layer, 5303 asemiconductor layer, 5303 b: semiconductor layer, 5304: conductivelayer, 5305: insulating layer, 5306: conductive layer, 5307: liquidcrystal layer, 5308: conductive layer, 5350: region, 5351: region, 5352:semiconductor substrate: 5353: region, 5354: insulating layer, 5355:region, 5356: insulating layer, 5357: conductive layer, 5358: insulatinglayer, 5359: conductive layer, 5360: video signal, 5361: circuit, 5361a: circuit, 5361 b: circuit, 5362: circuit, 5362 a: circuit, 5362 b;circuit, 5363: circuit, 5364: pixel portion, 5365: circuit, 5366:lighting device, 5367: pixel, 5371: wiring, 5372: wiring, 5373: wiring,5380: substrate, and 5381: input terminal

The invention claimed is:
 1. A method for driving a display device,comprising: performing a frame interpolation processing using a firstimage data and a second image data so that frame frequency can be madehigher by the number of interpolated frames; performing a firstsuper-resolution processing on a third image data generated by the frameinterpolation processing; and performing a second super-resolutionprocessing on the first image data, wherein the frame interpolationprocessing and the second super-resolution processing are concurrentlyperformed, and wherein the first super-resolution processing isperformed after the frame interpolation processing.
 2. The method fordriving a display device according to claim 1, further comprising a stepof performing converting an interlace image into a progressive imagebefore the frame interpolation processing.
 3. The method for driving adisplay device according to claim 1, wherein at least one of the firstsuper-resolution processing and the second super-resolution processingis performed in a part of a region in a screen.
 4. A method for drivinga display device, comprising: performing a frame interpolationprocessing using a first image data and a second image data so thatframe frequency can be made higher by the number of interpolated frames;performing a first super-resolution processing on a third image datagenerated by the frame interpolation processing; and performing a secondsuper-resolution processing on the first image data, wherein the frameinterpolation processing and the second super-resolution processing areconcurrently performed.
 5. The method for driving a display deviceaccording to claim 4, further comprising a step of performing convertingan interlace image into a progressive image before the frameinterpolation processing.
 6. The method for driving a display deviceaccording to claim 4, wherein the first super-resolution processing isperformed in a part of a region in a screen.
 7. The method for driving adisplay device according to claim 4, wherein the second super-resolutionprocessing is performed in a part of a region in a screen.
 8. A methodfor driving a display device, comprising: performing a frameinterpolation processing using a first image data and a second imagedata so that frame frequency can be made higher by the number ofinterpolated frames; performing a first super-resolution processing on athird image data generated by the frame interpolation processing;performing a second super-resolution processing on the first image data;and performing a local dimming processing after the secondsuper-resolution processing, wherein the frame interpolation processingand the second super-resolution processing are concurrently performed.9. The method for driving a display device according to claim 8, furthercomprising a step of performing converting an interlace image into aprogressive image before the frame interpolation processing.
 10. Themethod for driving a display device according to claim 8, wherein atleast one of the first super-resolution processing and the secondsuper-resolution processing is performed in a part of a region in ascreen.
 11. The method for driving a display device according to claim8, wherein the local dimming processing is performed in a part of aregion in a screen.
 12. A method for driving a display device,comprising: performing a frame interpolation processing using a firstimage data and a second image data so that frame frequency can be madehigher by the number of interpolated frames; performing a firstsuper-resolution processing on a third image data generated by the frameinterpolation processing; performing a second super-resolutionprocessing on the first image data; performing a local dimmingprocessing after the second super-resolution processing; and performingan overdrive processing after the local dimming processing, wherein theframe interpolation processing and the second super-resolutionprocessing are concurrently performed.
 13. The method for driving adisplay device according to claim 12, further comprising a step ofperforming converting an interlace image into a progressive image beforethe frame interpolation processing.
 14. The method for driving a displaydevice according to claim 12, wherein at least one of the firstsuper-resolution processing and the second super-resolution processingis performed in a part of a region in a screen.
 15. The method fordriving a display device according to claim 12, wherein the localdimming processing is performed in a part of a region in a screen. 16.The method for driving a display device according to claim 12, whereinthe overdrive processing is performed in a part of a region in a screen.